2024-06-11T17:04:38.358 INFO:root:teuthology version: 0.0.1.dev303+g861a8dc 2024-06-11T17:04:38.358 DEBUG:teuthology.run:Teuthology command: teuthology --name lflores-2024-06-10_22:21:08-rados-wip-lflores-testing-2-2024-06-10-1925-distro-default-smithi --verbose --description rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} --archive /home/teuthworker/archive/lflores-2024-06-10_22:21:08-rados-wip-lflores-testing-2-2024-06-10-1925-distro-default-smithi/7749723 --owner scheduled_lflores@teuthology -- /home/teuthworker/archive/lflores-2024-06-10_22:21:08-rados-wip-lflores-testing-2-2024-06-10-1925-distro-default-smithi/7749723/orig.config.yaml 2024-06-11T17:04:38.396 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-11T17:04:38.482 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/lflores-2024-06-10_22:21:08-rados-wip-lflores-testing-2-2024-06-10-1925-distro-default-smithi/7749723 branch: wip-lflores-testing-2-2024-06-10-1925 description: rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} email: null first_in_suite: false job_id: '7749723' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: lflores-2024-06-10_22:21:08-rados-wip-lflores-testing-2-2024-06-10-1925-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-lflores-testing-2-2024-06-10-1925 ceph: conf: client: debug ms: 1 global: mon client directed command retry: 5 mon election default strategy: 3 ms bind msgr1: false ms bind msgr2: true ms inject socket failures: 5000 ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub interval: 300 mon warn on pool no app: false paxos service trim min: 10 osd: bluefs allocator: hybrid bluestore allocator: hybrid bluestore block size: 96636764160 bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd class default list: '*' osd class load list: '*' osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(CEPHADM_STRAY_DAEMON\) sha1: 37bbe1d8d788b7c9a71280e7d510c295a5853f0b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 37bbe1d8d788b7c9a71280e7d510c295a5853f0b thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lflores-testing-2-2024-06-10-1925 sha1: 37bbe1d8d788b7c9a71280e7d510c295a5853f0b owner: scheduled_lflores@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 7590 sha1: 37bbe1d8d788b7c9a71280e7d510c295a5853f0b sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-lflores-testing-2-2024-06-10-1925 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_37bbe1d8d788b7c9a71280e7d510c295a5853f0b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 37bbe1d8d788b7c9a71280e7d510c295a5853f0b targets: smithi130.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMEVIOKax7L8HABjAXmabrvjcIvOwt8ZoXV7eadY/Q2cirnplaKZCSY2F32IOvoWcKTf+fydBe1iYnwXax7nJUI= smithi172.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHRxNdRdXRPyDWdHKr2RkGUHfnE1dAN4tWIlaZ+C0SBFPtjrAYNe758bWGqzrVgL4AXIHDMfpZ3/Z9nknYsJ2Mw= tasks: - install: extra_system_packages: deb: - sqlite3 rpm: - sqlite-devel - ceph: null - workunit: clients: client.0: - rados/test.sh - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 861a8dcf7aa816a26e13f039336f7ed0a9aec0fa timestamp: 2024-06-10_22:21:08 tube: smithi user: lflores verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-06-11T17:04:38.482 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_37bbe1d8d788b7c9a71280e7d510c295a5853f0b/qa; will attempt to use it 2024-06-11T17:04:38.483 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_37bbe1d8d788b7c9a71280e7d510c295a5853f0b/qa/tasks 2024-06-11T17:04:38.483 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-06-11T17:04:38.485 INFO:teuthology.task.internal:Checking packages... 2024-06-11T17:04:38.505 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '37bbe1d8d788b7c9a71280e7d510c295a5853f0b' 2024-06-11T17:04:38.506 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-06-11T17:04:38.506 INFO:teuthology.packaging:ref: None 2024-06-11T17:04:38.506 INFO:teuthology.packaging:tag: None 2024-06-11T17:04:38.506 INFO:teuthology.packaging:branch: wip-lflores-testing-2-2024-06-10-1925 2024-06-11T17:04:38.506 INFO:teuthology.packaging:sha1: 37bbe1d8d788b7c9a71280e7d510c295a5853f0b 2024-06-11T17:04:38.506 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-lflores-testing-2-2024-06-10-1925 2024-06-11T17:04:38.722 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-4216-g37bbe1d8-1jammy 2024-06-11T17:04:38.724 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-06-11T17:04:38.732 INFO:teuthology.task.internal:no buildpackages task found 2024-06-11T17:04:38.732 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-06-11T17:04:38.756 INFO:teuthology.task.internal:Saving configuration 2024-06-11T17:04:38.770 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-06-11T17:04:38.779 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-06-11T17:04:38.814 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi130.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-06-10_22:21:08-rados-wip-lflores-testing-2-2024-06-10-1925-distro-default-smithi/7749723', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-11 16:59:03.769894', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJImWPMpYpxqnQIfvqEEKIxZdT0axCCxRGQ1SS21e8Uz'} 2024-06-11T17:04:38.839 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-06-10_22:21:08-rados-wip-lflores-testing-2-2024-06-10-1925-distro-default-smithi/7749723', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-11 16:59:03.771026', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAzQ54cns90j5zPI4Ea+/E6qQXSZEARskJ2SACC8GVwD'} 2024-06-11T17:04:38.839 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-06-11T17:04:38.847 INFO:teuthology.task.internal:roles: ubuntu@smithi130.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-06-11T17:04:38.848 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-06-11T17:04:38.848 INFO:teuthology.run_tasks:Running task console_log... 2024-06-11T17:04:38.900 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb5769cbbe0>, signals=[15]) 2024-06-11T17:04:38.900 INFO:teuthology.run_tasks:Running task internal.connect... 2024-06-11T17:04:38.907 INFO:teuthology.task.internal:Opening connections... 2024-06-11T17:04:38.907 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi130.front.sepia.ceph.com 2024-06-11T17:04:38.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T17:04:38.990 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi172.front.sepia.ceph.com 2024-06-11T17:04:38.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T17:04:39.070 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-06-11T17:04:39.080 DEBUG:teuthology.orchestra.run.smithi130:> uname -m 2024-06-11T17:04:39.085 INFO:teuthology.orchestra.run.smithi130.stdout:x86_64 2024-06-11T17:04:39.085 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release 2024-06-11T17:04:39.135 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-06-11T17:04:39.135 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="Ubuntu" 2024-06-11T17:04:39.135 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="22.04" 2024-06-11T17:04:39.135 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-06-11T17:04:39.135 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_CODENAME=jammy 2024-06-11T17:04:39.135 INFO:teuthology.orchestra.run.smithi130.stdout:ID=ubuntu 2024-06-11T17:04:39.135 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE=debian 2024-06-11T17:04:39.135 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://www.ubuntu.com/" 2024-06-11T17:04:39.135 INFO:teuthology.orchestra.run.smithi130.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-06-11T17:04:39.135 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-06-11T17:04:39.135 INFO:teuthology.orchestra.run.smithi130.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-06-11T17:04:39.135 INFO:teuthology.orchestra.run.smithi130.stdout:UBUNTU_CODENAME=jammy 2024-06-11T17:04:39.136 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server 2024-06-11T17:04:39.156 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2024-06-11T17:04:39.161 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2024-06-11T17:04:39.162 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-06-11T17:04:39.209 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-06-11T17:04:39.209 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Ubuntu" 2024-06-11T17:04:39.209 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="22.04" 2024-06-11T17:04:39.209 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-06-11T17:04:39.209 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_CODENAME=jammy 2024-06-11T17:04:39.209 INFO:teuthology.orchestra.run.smithi172.stdout:ID=ubuntu 2024-06-11T17:04:39.209 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE=debian 2024-06-11T17:04:39.210 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.ubuntu.com/" 2024-06-11T17:04:39.210 INFO:teuthology.orchestra.run.smithi172.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-06-11T17:04:39.210 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-06-11T17:04:39.210 INFO:teuthology.orchestra.run.smithi172.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-06-11T17:04:39.210 INFO:teuthology.orchestra.run.smithi172.stdout:UBUNTU_CODENAME=jammy 2024-06-11T17:04:39.210 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-06-11T17:04:39.232 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-06-11T17:04:39.243 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-06-11T17:04:39.252 INFO:teuthology.task.internal:Checking for old test directory... 2024-06-11T17:04:39.252 DEBUG:teuthology.orchestra.run.smithi130:> test '!' -e /home/ubuntu/cephtest 2024-06-11T17:04:39.255 DEBUG:teuthology.orchestra.run.smithi172:> test '!' -e /home/ubuntu/cephtest 2024-06-11T17:04:39.260 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-06-11T17:04:39.271 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-06-11T17:04:39.271 DEBUG:teuthology.orchestra.run.smithi130:> test -z $(ls -A /var/lib/ceph) 2024-06-11T17:04:39.304 DEBUG:teuthology.orchestra.run.smithi172:> test -z $(ls -A /var/lib/ceph) 2024-06-11T17:04:39.387 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-06-11T17:04:39.436 INFO:teuthology.run_tasks:Running task kernel... 2024-06-11T17:04:39.454 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-06-11T17:04:39.454 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-06-11T17:04:39.455 DEBUG:teuthology.orchestra.run.smithi130:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-11T17:04:39.455 DEBUG:teuthology.orchestra.run.smithi172:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-11T17:04:39.460 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-11T17:04:39.460 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-11T17:04:39.461 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2024-06-11T17:04:39.461 DEBUG:teuthology.orchestra.run.smithi130:> uname -r 2024-06-11T17:04:39.507 INFO:teuthology.orchestra.run.smithi130.stdout:5.15.0-56-generic 2024-06-11T17:04:39.507 INFO:teuthology.task.kernel:Running kernel on smithi130: 5.15.0-56-generic 2024-06-11T17:04:39.507 DEBUG:teuthology.orchestra.run.smithi130:> sudo apt-get clean 2024-06-11T17:04:39.508 INFO:teuthology.orchestra.run.smithi172.stdout:5.15.0-56-generic 2024-06-11T17:04:39.508 INFO:teuthology.task.kernel:Running kernel on smithi172: 5.15.0-56-generic 2024-06-11T17:04:39.509 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-get clean 2024-06-11T17:04:39.637 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-get update 2024-06-11T17:04:39.640 DEBUG:teuthology.orchestra.run.smithi130:> sudo apt-get update 2024-06-11T17:04:39.778 INFO:teuthology.orchestra.run.smithi130.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-06-11T17:04:39.894 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-06-11T17:04:39.914 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-06-11T17:04:39.916 INFO:teuthology.orchestra.run.smithi172.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-06-11T17:04:39.977 INFO:teuthology.orchestra.run.smithi130.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-06-11T17:04:40.038 INFO:teuthology.orchestra.run.smithi130.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [478 kB] 2024-06-11T17:04:40.121 INFO:teuthology.orchestra.run.smithi130.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,506 kB] 2024-06-11T17:04:40.166 INFO:teuthology.orchestra.run.smithi130.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [257 kB] 2024-06-11T17:04:40.170 INFO:teuthology.orchestra.run.smithi130.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-06-11T17:04:40.171 INFO:teuthology.orchestra.run.smithi130.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-06-11T17:04:40.172 INFO:teuthology.orchestra.run.smithi130.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,919 kB] 2024-06-11T17:04:40.193 INFO:teuthology.orchestra.run.smithi130.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [326 kB] 2024-06-11T17:04:40.198 INFO:teuthology.orchestra.run.smithi130.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-06-11T17:04:40.198 INFO:teuthology.orchestra.run.smithi130.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [606 kB] 2024-06-11T17:04:40.205 INFO:teuthology.orchestra.run.smithi130.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [857 kB] 2024-06-11T17:04:40.213 INFO:teuthology.orchestra.run.smithi130.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [166 kB] 2024-06-11T17:04:40.214 INFO:teuthology.orchestra.run.smithi130.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-06-11T17:04:40.216 INFO:teuthology.orchestra.run.smithi130.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-06-11T17:04:40.216 INFO:teuthology.orchestra.run.smithi130.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-06-11T17:04:40.224 INFO:teuthology.orchestra.run.smithi130.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-06-11T17:04:40.236 INFO:teuthology.orchestra.run.smithi130.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-06-11T17:04:40.367 INFO:teuthology.orchestra.run.smithi130.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-06-11T17:04:40.399 INFO:teuthology.orchestra.run.smithi172.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [478 kB] 2024-06-11T17:04:40.506 INFO:teuthology.orchestra.run.smithi172.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-06-11T17:04:40.672 INFO:teuthology.orchestra.run.smithi130.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [639 kB] 2024-06-11T17:04:40.685 INFO:teuthology.orchestra.run.smithi172.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,506 kB] 2024-06-11T17:04:40.905 INFO:teuthology.orchestra.run.smithi172.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [257 kB] 2024-06-11T17:04:40.930 INFO:teuthology.orchestra.run.smithi130.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,718 kB] 2024-06-11T17:04:40.947 INFO:teuthology.orchestra.run.smithi172.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-06-11T17:04:40.947 INFO:teuthology.orchestra.run.smithi172.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-06-11T17:04:40.979 INFO:teuthology.orchestra.run.smithi172.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,919 kB] 2024-06-11T17:04:41.282 INFO:teuthology.orchestra.run.smithi172.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [326 kB] 2024-06-11T17:04:41.329 INFO:teuthology.orchestra.run.smithi172.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-06-11T17:04:41.329 INFO:teuthology.orchestra.run.smithi172.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [606 kB] 2024-06-11T17:04:41.393 INFO:teuthology.orchestra.run.smithi130.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [316 kB] 2024-06-11T17:04:41.449 INFO:teuthology.orchestra.run.smithi172.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [857 kB] 2024-06-11T17:04:41.460 INFO:teuthology.orchestra.run.smithi130.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-06-11T17:04:41.461 INFO:teuthology.orchestra.run.smithi130.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,975 kB] 2024-06-11T17:04:41.528 INFO:teuthology.orchestra.run.smithi172.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-06-11T17:04:41.746 INFO:teuthology.orchestra.run.smithi172.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [166 kB] 2024-06-11T17:04:41.755 INFO:teuthology.orchestra.run.smithi130.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-06-11T17:04:41.757 INFO:teuthology.orchestra.run.smithi130.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [336 kB] 2024-06-11T17:04:41.838 INFO:teuthology.orchestra.run.smithi130.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-06-11T17:04:42.003 INFO:teuthology.orchestra.run.smithi130.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [706 kB] 2024-06-11T17:04:42.147 INFO:teuthology.orchestra.run.smithi172.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-06-11T17:04:42.153 INFO:teuthology.orchestra.run.smithi172.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-06-11T17:04:42.153 INFO:teuthology.orchestra.run.smithi172.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-06-11T17:04:42.168 INFO:teuthology.orchestra.run.smithi172.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-06-11T17:04:42.171 INFO:teuthology.orchestra.run.smithi172.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-06-11T17:04:42.590 INFO:teuthology.orchestra.run.smithi130.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,086 kB] 2024-06-11T17:04:42.634 INFO:teuthology.orchestra.run.smithi172.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [639 kB] 2024-06-11T17:04:42.727 INFO:teuthology.orchestra.run.smithi130.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [251 kB] 2024-06-11T17:04:42.797 INFO:teuthology.orchestra.run.smithi130.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-06-11T17:04:42.798 INFO:teuthology.orchestra.run.smithi130.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.0 kB] 2024-06-11T17:04:42.801 INFO:teuthology.orchestra.run.smithi130.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-06-11T17:04:42.801 INFO:teuthology.orchestra.run.smithi130.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.7 kB] 2024-06-11T17:04:42.803 INFO:teuthology.orchestra.run.smithi130.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-06-11T17:04:42.804 INFO:teuthology.orchestra.run.smithi130.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-06-11T17:04:42.808 INFO:teuthology.orchestra.run.smithi130.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-06-11T17:04:42.813 INFO:teuthology.orchestra.run.smithi130.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-06-11T17:04:42.978 INFO:teuthology.orchestra.run.smithi130.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-06-11T17:04:43.060 INFO:teuthology.orchestra.run.smithi130.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-06-11T17:04:43.175 INFO:teuthology.orchestra.run.smithi130.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-06-11T17:04:43.223 INFO:teuthology.orchestra.run.smithi130.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.3 kB] 2024-06-11T17:04:43.250 INFO:teuthology.orchestra.run.smithi130.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-06-11T17:04:45.473 INFO:teuthology.orchestra.run.smithi172.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,718 kB] 2024-06-11T17:04:47.415 INFO:teuthology.orchestra.run.smithi130.stdout:Fetched 14.0 MB in 4s (3,939 kB/s) 2024-06-11T17:04:48.586 INFO:teuthology.orchestra.run.smithi172.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [316 kB] 2024-06-11T17:04:48.714 INFO:teuthology.orchestra.run.smithi130.stdout:Reading package lists... 2024-06-11T17:04:48.731 DEBUG:teuthology.orchestra.run.smithi130:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-06-11T17:04:48.785 INFO:teuthology.orchestra.run.smithi130.stdout:Reading package lists... 2024-06-11T17:04:48.964 INFO:teuthology.orchestra.run.smithi130.stdout:Building dependency tree... 2024-06-11T17:04:48.965 INFO:teuthology.orchestra.run.smithi130.stdout:Reading state information... 2024-06-11T17:04:49.123 INFO:teuthology.orchestra.run.smithi130.stdout:The following packages were automatically installed and are no longer required: 2024-06-11T17:04:49.123 INFO:teuthology.orchestra.run.smithi130.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-06-11T17:04:49.124 INFO:teuthology.orchestra.run.smithi130.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-06-11T17:04:49.124 INFO:teuthology.orchestra.run.smithi130.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-06-11T17:04:49.124 INFO:teuthology.orchestra.run.smithi130.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-06-11T17:04:49.124 INFO:teuthology.orchestra.run.smithi130.stdout: python2.7-minimal 2024-06-11T17:04:49.124 INFO:teuthology.orchestra.run.smithi130.stdout:Use 'sudo apt autoremove' to remove them. 2024-06-11T17:04:49.124 INFO:teuthology.orchestra.run.smithi130.stdout:The following additional packages will be installed: 2024-06-11T17:04:49.124 INFO:teuthology.orchestra.run.smithi130.stdout: linux-generic linux-headers-5.15.0-112 linux-headers-5.15.0-112-generic 2024-06-11T17:04:49.124 INFO:teuthology.orchestra.run.smithi130.stdout: linux-headers-generic linux-image-5.15.0-112-generic 2024-06-11T17:04:49.125 INFO:teuthology.orchestra.run.smithi130.stdout: linux-modules-5.15.0-112-generic linux-modules-extra-5.15.0-112-generic 2024-06-11T17:04:49.126 INFO:teuthology.orchestra.run.smithi130.stdout:Suggested packages: 2024-06-11T17:04:49.126 INFO:teuthology.orchestra.run.smithi130.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-06-11T17:04:49.126 INFO:teuthology.orchestra.run.smithi130.stdout:Recommended packages: 2024-06-11T17:04:49.126 INFO:teuthology.orchestra.run.smithi130.stdout: thermald 2024-06-11T17:04:49.165 INFO:teuthology.orchestra.run.smithi130.stdout:The following NEW packages will be installed: 2024-06-11T17:04:49.165 INFO:teuthology.orchestra.run.smithi130.stdout: linux-headers-5.15.0-112 linux-headers-5.15.0-112-generic 2024-06-11T17:04:49.165 INFO:teuthology.orchestra.run.smithi130.stdout: linux-image-5.15.0-112-generic linux-modules-5.15.0-112-generic 2024-06-11T17:04:49.165 INFO:teuthology.orchestra.run.smithi130.stdout: linux-modules-extra-5.15.0-112-generic 2024-06-11T17:04:49.166 INFO:teuthology.orchestra.run.smithi130.stdout:The following packages will be upgraded: 2024-06-11T17:04:49.167 INFO:teuthology.orchestra.run.smithi130.stdout: linux-generic linux-headers-generic linux-image-generic 2024-06-11T17:04:49.223 INFO:teuthology.orchestra.run.smithi130.stdout:3 upgraded, 5 newly installed, 0 to remove and 324 not upgraded. 2024-06-11T17:04:49.223 INFO:teuthology.orchestra.run.smithi130.stdout:Need to get 113 MB of archives. 2024-06-11T17:04:49.223 INFO:teuthology.orchestra.run.smithi130.stdout:After this operation, 583 MB of additional disk space will be used. 2024-06-11T17:04:49.223 INFO:teuthology.orchestra.run.smithi130.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-112-generic amd64 5.15.0-112.122 [22.6 MB] 2024-06-11T17:04:49.718 INFO:teuthology.orchestra.run.smithi172.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-06-11T17:04:49.723 INFO:teuthology.orchestra.run.smithi172.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,975 kB] 2024-06-11T17:04:49.730 INFO:teuthology.orchestra.run.smithi130.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-112-generic amd64 5.15.0-112.122 [11.5 MB] 2024-06-11T17:04:49.861 INFO:teuthology.orchestra.run.smithi130.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-112-generic amd64 5.15.0-112.122 [63.9 MB] 2024-06-11T17:04:51.048 INFO:teuthology.orchestra.run.smithi130.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.112.112 [1,692 B] 2024-06-11T17:04:51.048 INFO:teuthology.orchestra.run.smithi130.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.112.112 [2,510 B] 2024-06-11T17:04:51.048 INFO:teuthology.orchestra.run.smithi130.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-112 all 5.15.0-112.122 [12.3 MB] 2024-06-11T17:04:51.609 INFO:teuthology.orchestra.run.smithi130.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-112-generic amd64 5.15.0-112.122 [2,904 kB] 2024-06-11T17:04:51.748 INFO:teuthology.orchestra.run.smithi130.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.112.112 [2,360 B] 2024-06-11T17:04:52.142 INFO:teuthology.orchestra.run.smithi130.stdout:Fetched 113 MB in 3s (44.0 MB/s) 2024-06-11T17:04:52.330 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package linux-modules-5.15.0-112-generic. 2024-06-11T17:04:52.796 INFO:teuthology.orchestra.run.smithi172.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-06-11T17:04:52.811 INFO:teuthology.orchestra.run.smithi172.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [336 kB] 2024-06-11T17:04:54.384 INFO:teuthology.orchestra.run.smithi130.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-06-11T17:04:54.390 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../0-linux-modules-5.15.0-112-generic_5.15.0-112.122_amd64.deb ... 2024-06-11T17:04:54.569 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking linux-modules-5.15.0-112-generic (5.15.0-112.122) ... 2024-06-11T17:04:54.587 INFO:teuthology.orchestra.run.smithi172.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-06-11T17:04:54.752 INFO:teuthology.orchestra.run.smithi172.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [706 kB] 2024-06-11T17:04:55.885 INFO:teuthology.orchestra.run.smithi172.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,086 kB] 2024-06-11T17:04:56.588 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package linux-image-5.15.0-112-generic. 2024-06-11T17:04:56.609 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../1-linux-image-5.15.0-112-generic_5.15.0-112.122_amd64.deb ... 2024-06-11T17:04:56.699 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking linux-image-5.15.0-112-generic (5.15.0-112.122) ... 2024-06-11T17:04:57.124 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-112-generic. 2024-06-11T17:04:57.145 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-112-generic_5.15.0-112.122_amd64.deb ... 2024-06-11T17:04:57.182 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking linux-modules-extra-5.15.0-112-generic (5.15.0-112.122) ... 2024-06-11T17:04:59.572 INFO:teuthology.orchestra.run.smithi172.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [251 kB] 2024-06-11T17:05:03.203 INFO:teuthology.orchestra.run.smithi172.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-06-11T17:05:03.210 INFO:teuthology.orchestra.run.smithi172.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-06-11T17:05:03.211 INFO:teuthology.orchestra.run.smithi172.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.0 kB] 2024-06-11T17:05:03.226 INFO:teuthology.orchestra.run.smithi172.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.7 kB] 2024-06-11T17:05:03.230 INFO:teuthology.orchestra.run.smithi172.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-06-11T17:05:03.230 INFO:teuthology.orchestra.run.smithi172.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-06-11T17:05:03.292 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../3-linux-generic_5.15.0.112.112_amd64.deb ... 2024-06-11T17:05:03.420 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking linux-generic (5.15.0.112.112) over (5.15.0.56.54) ... 2024-06-11T17:05:03.762 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.112.112_amd64.deb ... 2024-06-11T17:05:03.873 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking linux-image-generic (5.15.0.112.112) over (5.15.0.56.54) ... 2024-06-11T17:05:04.162 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package linux-headers-5.15.0-112. 2024-06-11T17:05:04.184 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../5-linux-headers-5.15.0-112_5.15.0-112.122_all.deb ... 2024-06-11T17:05:04.228 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking linux-headers-5.15.0-112 (5.15.0-112.122) ... 2024-06-11T17:05:07.180 INFO:teuthology.orchestra.run.smithi172.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-06-11T17:05:07.202 INFO:teuthology.orchestra.run.smithi172.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-06-11T17:05:07.369 INFO:teuthology.orchestra.run.smithi172.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-06-11T17:05:09.736 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package linux-headers-5.15.0-112-generic. 2024-06-11T17:05:09.773 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../6-linux-headers-5.15.0-112-generic_5.15.0-112.122_amd64.deb ... 2024-06-11T17:05:09.811 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking linux-headers-5.15.0-112-generic (5.15.0-112.122) ... 2024-06-11T17:05:11.057 INFO:teuthology.orchestra.run.smithi172.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-06-11T17:05:12.746 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.112.112_amd64.deb ... 2024-06-11T17:05:12.872 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking linux-headers-generic (5.15.0.112.112) over (5.15.0.56.54) ... 2024-06-11T17:05:13.197 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up linux-headers-5.15.0-112 (5.15.0-112.122) ... 2024-06-11T17:05:13.318 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up linux-headers-5.15.0-112-generic (5.15.0-112.122) ... 2024-06-11T17:05:13.444 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up linux-headers-generic (5.15.0.112.112) ... 2024-06-11T17:05:13.572 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up linux-image-5.15.0-112-generic (5.15.0-112.122) ... 2024-06-11T17:05:14.019 INFO:teuthology.orchestra.run.smithi172.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-06-11T17:05:14.067 INFO:teuthology.orchestra.run.smithi172.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.3 kB] 2024-06-11T17:05:14.125 INFO:teuthology.orchestra.run.smithi172.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-06-11T17:05:14.902 INFO:teuthology.orchestra.run.smithi130.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-06-11T17:05:14.902 INFO:teuthology.orchestra.run.smithi130.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-06-11T17:05:14.902 INFO:teuthology.orchestra.run.smithi130.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-112-generic 2024-06-11T17:05:14.902 INFO:teuthology.orchestra.run.smithi130.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-112-generic 2024-06-11T17:05:15.059 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up linux-modules-extra-5.15.0-112-generic (5.15.0-112.122) ... 2024-06-11T17:05:16.468 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up linux-modules-5.15.0-112-generic (5.15.0-112.122) ... 2024-06-11T17:05:17.861 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up linux-image-generic (5.15.0.112.112) ... 2024-06-11T17:05:17.987 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up linux-generic (5.15.0.112.112) ... 2024-06-11T17:05:18.105 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for linux-image-5.15.0-112-generic (5.15.0-112.122) ... 2024-06-11T17:05:18.175 INFO:teuthology.orchestra.run.smithi130.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-06-11T17:05:18.175 INFO:teuthology.orchestra.run.smithi130.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-112-generic 2024-06-11T17:05:18.531 INFO:teuthology.orchestra.run.smithi172.stdout:Fetched 14.0 MB in 34s (406 kB/s) 2024-06-11T17:05:20.102 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2024-06-11T17:05:20.122 DEBUG:teuthology.orchestra.run.smithi172:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-06-11T17:05:20.181 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2024-06-11T17:05:20.386 INFO:teuthology.orchestra.run.smithi172.stdout:Building dependency tree... 2024-06-11T17:05:20.386 INFO:teuthology.orchestra.run.smithi172.stdout:Reading state information... 2024-06-11T17:05:20.548 INFO:teuthology.orchestra.run.smithi172.stdout:The following packages were automatically installed and are no longer required: 2024-06-11T17:05:20.548 INFO:teuthology.orchestra.run.smithi172.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-06-11T17:05:20.548 INFO:teuthology.orchestra.run.smithi172.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-06-11T17:05:20.548 INFO:teuthology.orchestra.run.smithi172.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-06-11T17:05:20.548 INFO:teuthology.orchestra.run.smithi172.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-06-11T17:05:20.548 INFO:teuthology.orchestra.run.smithi172.stdout: python2.7-minimal 2024-06-11T17:05:20.549 INFO:teuthology.orchestra.run.smithi172.stdout:Use 'sudo apt autoremove' to remove them. 2024-06-11T17:05:20.549 INFO:teuthology.orchestra.run.smithi172.stdout:The following additional packages will be installed: 2024-06-11T17:05:20.550 INFO:teuthology.orchestra.run.smithi172.stdout: linux-generic linux-headers-5.15.0-112 linux-headers-5.15.0-112-generic 2024-06-11T17:05:20.550 INFO:teuthology.orchestra.run.smithi172.stdout: linux-headers-generic linux-image-5.15.0-112-generic 2024-06-11T17:05:20.550 INFO:teuthology.orchestra.run.smithi172.stdout: linux-modules-5.15.0-112-generic linux-modules-extra-5.15.0-112-generic 2024-06-11T17:05:20.551 INFO:teuthology.orchestra.run.smithi172.stdout:Suggested packages: 2024-06-11T17:05:20.551 INFO:teuthology.orchestra.run.smithi172.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-06-11T17:05:20.551 INFO:teuthology.orchestra.run.smithi172.stdout:Recommended packages: 2024-06-11T17:05:20.551 INFO:teuthology.orchestra.run.smithi172.stdout: thermald 2024-06-11T17:05:20.594 INFO:teuthology.orchestra.run.smithi172.stdout:The following NEW packages will be installed: 2024-06-11T17:05:20.594 INFO:teuthology.orchestra.run.smithi172.stdout: linux-headers-5.15.0-112 linux-headers-5.15.0-112-generic 2024-06-11T17:05:20.594 INFO:teuthology.orchestra.run.smithi172.stdout: linux-image-5.15.0-112-generic linux-modules-5.15.0-112-generic 2024-06-11T17:05:20.594 INFO:teuthology.orchestra.run.smithi172.stdout: linux-modules-extra-5.15.0-112-generic 2024-06-11T17:05:20.594 INFO:teuthology.orchestra.run.smithi172.stdout:The following packages will be upgraded: 2024-06-11T17:05:20.594 INFO:teuthology.orchestra.run.smithi172.stdout: linux-generic linux-headers-generic linux-image-generic 2024-06-11T17:05:20.652 INFO:teuthology.orchestra.run.smithi172.stdout:3 upgraded, 5 newly installed, 0 to remove and 324 not upgraded. 2024-06-11T17:05:20.652 INFO:teuthology.orchestra.run.smithi172.stdout:Need to get 113 MB of archives. 2024-06-11T17:05:20.652 INFO:teuthology.orchestra.run.smithi172.stdout:After this operation, 583 MB of additional disk space will be used. 2024-06-11T17:05:20.652 INFO:teuthology.orchestra.run.smithi172.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-112-generic amd64 5.15.0-112.122 [22.6 MB] 2024-06-11T17:05:21.174 INFO:teuthology.orchestra.run.smithi172.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-112-generic amd64 5.15.0-112.122 [11.5 MB] 2024-06-11T17:05:21.309 INFO:teuthology.orchestra.run.smithi172.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-112-generic amd64 5.15.0-112.122 [63.9 MB] 2024-06-11T17:05:22.371 INFO:teuthology.orchestra.run.smithi172.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.112.112 [1,692 B] 2024-06-11T17:05:22.371 INFO:teuthology.orchestra.run.smithi172.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.112.112 [2,510 B] 2024-06-11T17:05:22.371 INFO:teuthology.orchestra.run.smithi172.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-112 all 5.15.0-112.122 [12.3 MB] 2024-06-11T17:05:22.697 INFO:teuthology.orchestra.run.smithi172.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-112-generic amd64 5.15.0-112.122 [2,904 kB] 2024-06-11T17:05:22.742 INFO:teuthology.orchestra.run.smithi172.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.112.112 [2,360 B] 2024-06-11T17:05:23.146 INFO:teuthology.orchestra.run.smithi172.stdout:Fetched 113 MB in 2s (52.9 MB/s) 2024-06-11T17:05:23.290 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package linux-modules-5.15.0-112-generic. 2024-06-11T17:05:25.324 INFO:teuthology.orchestra.run.smithi172.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-06-11T17:05:25.328 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../0-linux-modules-5.15.0-112-generic_5.15.0-112.122_amd64.deb ... 2024-06-11T17:05:25.579 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-modules-5.15.0-112-generic (5.15.0-112.122) ... 2024-06-11T17:05:27.863 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package linux-image-5.15.0-112-generic. 2024-06-11T17:05:27.884 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../1-linux-image-5.15.0-112-generic_5.15.0-112.122_amd64.deb ... 2024-06-11T17:05:27.979 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-image-5.15.0-112-generic (5.15.0-112.122) ... 2024-06-11T17:05:28.458 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-112-generic. 2024-06-11T17:05:28.478 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-112-generic_5.15.0-112.122_amd64.deb ... 2024-06-11T17:05:28.516 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-modules-extra-5.15.0-112-generic (5.15.0-112.122) ... 2024-06-11T17:05:31.789 INFO:teuthology.orchestra.run.smithi130.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-06-11T17:05:31.789 INFO:teuthology.orchestra.run.smithi130.stdout:Sourcing file `/etc/default/grub' 2024-06-11T17:05:31.800 INFO:teuthology.orchestra.run.smithi130.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-06-11T17:05:31.826 INFO:teuthology.orchestra.run.smithi130.stdout:Generating grub configuration file ... 2024-06-11T17:05:32.084 INFO:teuthology.orchestra.run.smithi130.stdout:Found linux image: /boot/vmlinuz-5.15.0-112-generic 2024-06-11T17:05:32.098 INFO:teuthology.orchestra.run.smithi130.stdout:Found initrd image: /boot/initrd.img-5.15.0-112-generic 2024-06-11T17:05:32.379 INFO:teuthology.orchestra.run.smithi130.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-06-11T17:05:32.385 INFO:teuthology.orchestra.run.smithi130.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-06-11T17:05:32.458 INFO:teuthology.orchestra.run.smithi130.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-06-11T17:05:32.463 INFO:teuthology.orchestra.run.smithi130.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-06-11T17:05:32.620 INFO:teuthology.orchestra.run.smithi130.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-06-11T17:05:32.620 INFO:teuthology.orchestra.run.smithi130.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-06-11T17:05:32.621 INFO:teuthology.orchestra.run.smithi130.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-06-11T17:05:32.656 INFO:teuthology.orchestra.run.smithi130.stdout:done 2024-06-11T17:05:33.151 DEBUG:teuthology.orchestra.run.smithi130:> dpkg -s linux-image-generic 2024-06-11T17:05:33.177 INFO:teuthology.orchestra.run.smithi130.stdout:Package: linux-image-generic 2024-06-11T17:05:33.177 INFO:teuthology.orchestra.run.smithi130.stdout:Status: install ok installed 2024-06-11T17:05:33.177 INFO:teuthology.orchestra.run.smithi130.stdout:Priority: optional 2024-06-11T17:05:33.177 INFO:teuthology.orchestra.run.smithi130.stdout:Section: kernel 2024-06-11T17:05:33.177 INFO:teuthology.orchestra.run.smithi130.stdout:Installed-Size: 21 2024-06-11T17:05:33.177 INFO:teuthology.orchestra.run.smithi130.stdout:Maintainer: Ubuntu Kernel Team 2024-06-11T17:05:33.177 INFO:teuthology.orchestra.run.smithi130.stdout:Architecture: amd64 2024-06-11T17:05:33.177 INFO:teuthology.orchestra.run.smithi130.stdout:Source: linux-meta 2024-06-11T17:05:33.177 INFO:teuthology.orchestra.run.smithi130.stdout:Version: 5.15.0.112.112 2024-06-11T17:05:33.177 INFO:teuthology.orchestra.run.smithi130.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-112), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-06-11T17:05:33.178 INFO:teuthology.orchestra.run.smithi130.stdout:Depends: linux-image-5.15.0-112-generic, linux-modules-extra-5.15.0-112-generic, linux-firmware, intel-microcode, amd64-microcode 2024-06-11T17:05:33.178 INFO:teuthology.orchestra.run.smithi130.stdout:Recommends: thermald 2024-06-11T17:05:33.178 INFO:teuthology.orchestra.run.smithi130.stdout:Description: Generic Linux kernel image 2024-06-11T17:05:33.178 INFO:teuthology.orchestra.run.smithi130.stdout: This package will always depend on the latest generic kernel image 2024-06-11T17:05:33.178 INFO:teuthology.orchestra.run.smithi130.stdout: available. 2024-06-11T17:05:33.178 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-112-generic 2024-06-11T17:05:33.178 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-06-11T17:05:33.178 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-06-11T17:05:33.179 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-06-11T17:05:33.179 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi130.front.sepia.ceph.com, path=None, version=distro) 2024-06-11T17:05:33.179 DEBUG:teuthology.orchestra.run.smithi130:> sudo apt-get clean 2024-06-11T17:05:33.342 DEBUG:teuthology.orchestra.run.smithi130:> sudo apt-get update 2024-06-11T17:05:33.468 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-06-11T17:05:33.468 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-06-11T17:05:33.481 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-06-11T17:05:33.502 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-06-11T17:05:34.827 INFO:teuthology.orchestra.run.smithi130.stdout:Reading package lists... 2024-06-11T17:05:34.845 DEBUG:teuthology.orchestra.run.smithi130:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-06-11T17:05:34.906 INFO:teuthology.orchestra.run.smithi130.stdout:Reading package lists... 2024-06-11T17:05:35.109 INFO:teuthology.orchestra.run.smithi130.stdout:Building dependency tree... 2024-06-11T17:05:35.110 INFO:teuthology.orchestra.run.smithi130.stdout:Reading state information... 2024-06-11T17:05:35.290 INFO:teuthology.orchestra.run.smithi130.stdout:linux-image-generic is already the newest version (5.15.0.112.112). 2024-06-11T17:05:35.291 INFO:teuthology.orchestra.run.smithi130.stdout:The following packages were automatically installed and are no longer required: 2024-06-11T17:05:35.291 INFO:teuthology.orchestra.run.smithi130.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-06-11T17:05:35.291 INFO:teuthology.orchestra.run.smithi130.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-06-11T17:05:35.291 INFO:teuthology.orchestra.run.smithi130.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-06-11T17:05:35.291 INFO:teuthology.orchestra.run.smithi130.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-06-11T17:05:35.291 INFO:teuthology.orchestra.run.smithi130.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-06-11T17:05:35.291 INFO:teuthology.orchestra.run.smithi130.stdout:Use 'sudo apt autoremove' to remove them. 2024-06-11T17:05:35.332 INFO:teuthology.orchestra.run.smithi130.stdout:0 upgraded, 0 newly installed, 0 to remove and 324 not upgraded. 2024-06-11T17:05:35.333 DEBUG:teuthology.orchestra.run.smithi130:> dpkg -s linux-image-generic 2024-06-11T17:05:35.349 INFO:teuthology.orchestra.run.smithi130.stdout:Package: linux-image-generic 2024-06-11T17:05:35.349 INFO:teuthology.orchestra.run.smithi130.stdout:Status: install ok installed 2024-06-11T17:05:35.349 INFO:teuthology.orchestra.run.smithi130.stdout:Priority: optional 2024-06-11T17:05:35.349 INFO:teuthology.orchestra.run.smithi130.stdout:Section: kernel 2024-06-11T17:05:35.349 INFO:teuthology.orchestra.run.smithi130.stdout:Installed-Size: 21 2024-06-11T17:05:35.349 INFO:teuthology.orchestra.run.smithi130.stdout:Maintainer: Ubuntu Kernel Team 2024-06-11T17:05:35.349 INFO:teuthology.orchestra.run.smithi130.stdout:Architecture: amd64 2024-06-11T17:05:35.349 INFO:teuthology.orchestra.run.smithi130.stdout:Source: linux-meta 2024-06-11T17:05:35.349 INFO:teuthology.orchestra.run.smithi130.stdout:Version: 5.15.0.112.112 2024-06-11T17:05:35.349 INFO:teuthology.orchestra.run.smithi130.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-112), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-06-11T17:05:35.350 INFO:teuthology.orchestra.run.smithi130.stdout:Depends: linux-image-5.15.0-112-generic, linux-modules-extra-5.15.0-112-generic, linux-firmware, intel-microcode, amd64-microcode 2024-06-11T17:05:35.350 INFO:teuthology.orchestra.run.smithi130.stdout:Recommends: thermald 2024-06-11T17:05:35.350 INFO:teuthology.orchestra.run.smithi130.stdout:Description: Generic Linux kernel image 2024-06-11T17:05:35.350 INFO:teuthology.orchestra.run.smithi130.stdout: This package will always depend on the latest generic kernel image 2024-06-11T17:05:35.350 INFO:teuthology.orchestra.run.smithi130.stdout: available. 2024-06-11T17:05:35.350 DEBUG:teuthology.orchestra.run.smithi130:> mktemp 2024-06-11T17:05:35.394 INFO:teuthology.orchestra.run.smithi130.stdout:/tmp/tmp.dpycmBPmgz 2024-06-11T17:05:35.394 DEBUG:teuthology.orchestra.run.smithi130:> sudo cp /boot/grub/grub.cfg /tmp/tmp.dpycmBPmgz 2024-06-11T17:05:35.450 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0666 /tmp/tmp.dpycmBPmgz 2024-06-11T17:05:35.523 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../3-linux-generic_5.15.0.112.112_amd64.deb ... 2024-06-11T17:05:35.576 DEBUG:teuthology.orchestra.remote:smithi130:/tmp/tmp.dpycmBPmgz is 10KB 2024-06-11T17:05:35.590 DEBUG:teuthology.orchestra.run.smithi130:> rm -fr /tmp/tmp.dpycmBPmgz 2024-06-11T17:05:35.596 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-06-11T17:05:35.648 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-generic (5.15.0.112.112) over (5.15.0.56.54) ... 2024-06-11T17:05:35.654 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-06-11T17:05:35.654 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-06-11T17:05:35.654 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-06-11T17:05:35.722 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-112-generic 2024-06-11T17:05:35.722 DEBUG:teuthology.orchestra.run.smithi130:> sudo update-grub 2024-06-11T17:05:35.991 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.112.112_amd64.deb ... 2024-06-11T17:05:36.086 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-image-generic (5.15.0.112.112) over (5.15.0.56.54) ... 2024-06-11T17:05:36.389 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package linux-headers-5.15.0-112. 2024-06-11T17:05:36.412 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../5-linux-headers-5.15.0-112_5.15.0-112.122_all.deb ... 2024-06-11T17:05:36.481 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-headers-5.15.0-112 (5.15.0-112.122) ... 2024-06-11T17:05:36.811 INFO:teuthology.orchestra.run.smithi130.stderr:Sourcing file `/etc/default/grub' 2024-06-11T17:05:36.812 INFO:teuthology.orchestra.run.smithi130.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-06-11T17:05:36.814 INFO:teuthology.orchestra.run.smithi130.stderr:Generating grub configuration file ... 2024-06-11T17:05:36.984 INFO:teuthology.orchestra.run.smithi130.stderr:Found linux image: /boot/vmlinuz-5.15.0-112-generic 2024-06-11T17:05:36.989 INFO:teuthology.orchestra.run.smithi130.stderr:Found initrd image: /boot/initrd.img-5.15.0-112-generic 2024-06-11T17:05:37.216 INFO:teuthology.orchestra.run.smithi130.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-06-11T17:05:37.220 INFO:teuthology.orchestra.run.smithi130.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-06-11T17:05:37.256 INFO:teuthology.orchestra.run.smithi130.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-06-11T17:05:37.262 INFO:teuthology.orchestra.run.smithi130.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-06-11T17:05:37.375 INFO:teuthology.orchestra.run.smithi130.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-06-11T17:05:37.375 INFO:teuthology.orchestra.run.smithi130.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-06-11T17:05:37.375 INFO:teuthology.orchestra.run.smithi130.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-06-11T17:05:37.393 INFO:teuthology.orchestra.run.smithi130.stderr:done 2024-06-11T17:05:37.395 DEBUG:teuthology.orchestra.run.smithi130:> sudo shutdown -r now 2024-06-11T17:05:43.123 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package linux-headers-5.15.0-112-generic. 2024-06-11T17:05:43.160 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../6-linux-headers-5.15.0-112-generic_5.15.0-112.122_amd64.deb ... 2024-06-11T17:05:43.214 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-headers-5.15.0-112-generic (5.15.0-112.122) ... 2024-06-11T17:05:45.982 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.112.112_amd64.deb ... 2024-06-11T17:05:46.107 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-headers-generic (5.15.0.112.112) over (5.15.0.56.54) ... 2024-06-11T17:05:46.482 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-headers-5.15.0-112 (5.15.0-112.122) ... 2024-06-11T17:05:46.629 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-headers-5.15.0-112-generic (5.15.0-112.122) ... 2024-06-11T17:05:46.746 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-headers-generic (5.15.0.112.112) ... 2024-06-11T17:05:46.882 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-image-5.15.0-112-generic (5.15.0-112.122) ... 2024-06-11T17:05:48.221 INFO:teuthology.orchestra.run.smithi172.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-06-11T17:05:48.221 INFO:teuthology.orchestra.run.smithi172.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-06-11T17:05:48.221 INFO:teuthology.orchestra.run.smithi172.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-112-generic 2024-06-11T17:05:48.221 INFO:teuthology.orchestra.run.smithi172.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-112-generic 2024-06-11T17:05:48.368 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-modules-extra-5.15.0-112-generic (5.15.0-112.122) ... 2024-06-11T17:05:49.778 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-modules-5.15.0-112-generic (5.15.0-112.122) ... 2024-06-11T17:05:51.195 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-image-generic (5.15.0.112.112) ... 2024-06-11T17:05:51.321 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-generic (5.15.0.112.112) ... 2024-06-11T17:05:51.468 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for linux-image-5.15.0-112-generic (5.15.0-112.122) ... 2024-06-11T17:05:51.533 INFO:teuthology.orchestra.run.smithi172.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-06-11T17:05:51.534 INFO:teuthology.orchestra.run.smithi172.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-112-generic 2024-06-11T17:06:05.876 INFO:teuthology.orchestra.run.smithi172.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-06-11T17:06:05.876 INFO:teuthology.orchestra.run.smithi172.stdout:Sourcing file `/etc/default/grub' 2024-06-11T17:06:05.895 INFO:teuthology.orchestra.run.smithi172.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-06-11T17:06:05.919 INFO:teuthology.orchestra.run.smithi172.stdout:Generating grub configuration file ... 2024-06-11T17:06:06.274 INFO:teuthology.orchestra.run.smithi172.stdout:Found linux image: /boot/vmlinuz-5.15.0-112-generic 2024-06-11T17:06:06.306 INFO:teuthology.orchestra.run.smithi172.stdout:Found initrd image: /boot/initrd.img-5.15.0-112-generic 2024-06-11T17:06:06.592 INFO:teuthology.orchestra.run.smithi172.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-06-11T17:06:06.597 INFO:teuthology.orchestra.run.smithi172.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-06-11T17:06:06.670 INFO:teuthology.orchestra.run.smithi172.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-06-11T17:06:06.675 INFO:teuthology.orchestra.run.smithi172.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-06-11T17:06:06.871 INFO:teuthology.orchestra.run.smithi172.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-06-11T17:06:06.871 INFO:teuthology.orchestra.run.smithi172.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-06-11T17:06:06.871 INFO:teuthology.orchestra.run.smithi172.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-06-11T17:06:06.912 INFO:teuthology.orchestra.run.smithi172.stdout:done 2024-06-11T17:06:07.405 DEBUG:teuthology.orchestra.run.smithi172:> dpkg -s linux-image-generic 2024-06-11T17:06:07.424 INFO:teuthology.orchestra.run.smithi172.stdout:Package: linux-image-generic 2024-06-11T17:06:07.424 INFO:teuthology.orchestra.run.smithi172.stdout:Status: install ok installed 2024-06-11T17:06:07.424 INFO:teuthology.orchestra.run.smithi172.stdout:Priority: optional 2024-06-11T17:06:07.424 INFO:teuthology.orchestra.run.smithi172.stdout:Section: kernel 2024-06-11T17:06:07.424 INFO:teuthology.orchestra.run.smithi172.stdout:Installed-Size: 21 2024-06-11T17:06:07.424 INFO:teuthology.orchestra.run.smithi172.stdout:Maintainer: Ubuntu Kernel Team 2024-06-11T17:06:07.424 INFO:teuthology.orchestra.run.smithi172.stdout:Architecture: amd64 2024-06-11T17:06:07.425 INFO:teuthology.orchestra.run.smithi172.stdout:Source: linux-meta 2024-06-11T17:06:07.425 INFO:teuthology.orchestra.run.smithi172.stdout:Version: 5.15.0.112.112 2024-06-11T17:06:07.425 INFO:teuthology.orchestra.run.smithi172.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-112), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-06-11T17:06:07.425 INFO:teuthology.orchestra.run.smithi172.stdout:Depends: linux-image-5.15.0-112-generic, linux-modules-extra-5.15.0-112-generic, linux-firmware, intel-microcode, amd64-microcode 2024-06-11T17:06:07.425 INFO:teuthology.orchestra.run.smithi172.stdout:Recommends: thermald 2024-06-11T17:06:07.425 INFO:teuthology.orchestra.run.smithi172.stdout:Description: Generic Linux kernel image 2024-06-11T17:06:07.425 INFO:teuthology.orchestra.run.smithi172.stdout: This package will always depend on the latest generic kernel image 2024-06-11T17:06:07.425 INFO:teuthology.orchestra.run.smithi172.stdout: available. 2024-06-11T17:06:07.425 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-112-generic 2024-06-11T17:06:07.425 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-06-11T17:06:07.425 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-06-11T17:06:07.426 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-06-11T17:06:07.426 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi172.front.sepia.ceph.com, path=None, version=distro) 2024-06-11T17:06:07.426 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-get clean 2024-06-11T17:06:07.440 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-06-11T17:06:07.441 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-06-11T17:06:07.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T17:06:07.602 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-get update 2024-06-11T17:06:07.724 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-06-11T17:06:07.838 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-06-11T17:06:07.922 INFO:teuthology.orchestra.run.smithi172.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-06-11T17:06:08.289 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-06-11T17:06:08.492 INFO:teuthology.orchestra.run.smithi172.stdout:Fetched 128 kB in 1s (177 kB/s) 2024-06-11T17:06:09.502 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2024-06-11T17:06:09.521 DEBUG:teuthology.orchestra.run.smithi172:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-06-11T17:06:09.574 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2024-06-11T17:06:09.757 INFO:teuthology.orchestra.run.smithi172.stdout:Building dependency tree... 2024-06-11T17:06:09.757 INFO:teuthology.orchestra.run.smithi172.stdout:Reading state information... 2024-06-11T17:06:09.920 INFO:teuthology.orchestra.run.smithi172.stdout:linux-image-generic is already the newest version (5.15.0.112.112). 2024-06-11T17:06:09.920 INFO:teuthology.orchestra.run.smithi172.stdout:The following packages were automatically installed and are no longer required: 2024-06-11T17:06:09.920 INFO:teuthology.orchestra.run.smithi172.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-06-11T17:06:09.920 INFO:teuthology.orchestra.run.smithi172.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-06-11T17:06:09.920 INFO:teuthology.orchestra.run.smithi172.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-06-11T17:06:09.921 INFO:teuthology.orchestra.run.smithi172.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-06-11T17:06:09.921 INFO:teuthology.orchestra.run.smithi172.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-06-11T17:06:09.921 INFO:teuthology.orchestra.run.smithi172.stdout:Use 'sudo apt autoremove' to remove them. 2024-06-11T17:06:09.959 INFO:teuthology.orchestra.run.smithi172.stdout:0 upgraded, 0 newly installed, 0 to remove and 324 not upgraded. 2024-06-11T17:06:09.961 DEBUG:teuthology.orchestra.run.smithi172:> dpkg -s linux-image-generic 2024-06-11T17:06:10.017 INFO:teuthology.orchestra.run.smithi172.stdout:Package: linux-image-generic 2024-06-11T17:06:10.017 INFO:teuthology.orchestra.run.smithi172.stdout:Status: install ok installed 2024-06-11T17:06:10.017 INFO:teuthology.orchestra.run.smithi172.stdout:Priority: optional 2024-06-11T17:06:10.017 INFO:teuthology.orchestra.run.smithi172.stdout:Section: kernel 2024-06-11T17:06:10.017 INFO:teuthology.orchestra.run.smithi172.stdout:Installed-Size: 21 2024-06-11T17:06:10.017 INFO:teuthology.orchestra.run.smithi172.stdout:Maintainer: Ubuntu Kernel Team 2024-06-11T17:06:10.017 INFO:teuthology.orchestra.run.smithi172.stdout:Architecture: amd64 2024-06-11T17:06:10.018 INFO:teuthology.orchestra.run.smithi172.stdout:Source: linux-meta 2024-06-11T17:06:10.018 INFO:teuthology.orchestra.run.smithi172.stdout:Version: 5.15.0.112.112 2024-06-11T17:06:10.018 INFO:teuthology.orchestra.run.smithi172.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-112), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-06-11T17:06:10.018 INFO:teuthology.orchestra.run.smithi172.stdout:Depends: linux-image-5.15.0-112-generic, linux-modules-extra-5.15.0-112-generic, linux-firmware, intel-microcode, amd64-microcode 2024-06-11T17:06:10.018 INFO:teuthology.orchestra.run.smithi172.stdout:Recommends: thermald 2024-06-11T17:06:10.018 INFO:teuthology.orchestra.run.smithi172.stdout:Description: Generic Linux kernel image 2024-06-11T17:06:10.018 INFO:teuthology.orchestra.run.smithi172.stdout: This package will always depend on the latest generic kernel image 2024-06-11T17:06:10.018 INFO:teuthology.orchestra.run.smithi172.stdout: available. 2024-06-11T17:06:10.018 DEBUG:teuthology.orchestra.run.smithi172:> mktemp 2024-06-11T17:06:10.064 INFO:teuthology.orchestra.run.smithi172.stdout:/tmp/tmp.dEtTSBcmk0 2024-06-11T17:06:10.064 DEBUG:teuthology.orchestra.run.smithi172:> sudo cp /boot/grub/grub.cfg /tmp/tmp.dEtTSBcmk0 2024-06-11T17:06:10.118 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0666 /tmp/tmp.dEtTSBcmk0 2024-06-11T17:06:10.234 DEBUG:teuthology.orchestra.remote:smithi172:/tmp/tmp.dEtTSBcmk0 is 10KB 2024-06-11T17:06:10.246 DEBUG:teuthology.orchestra.run.smithi172:> rm -fr /tmp/tmp.dEtTSBcmk0 2024-06-11T17:06:10.251 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-06-11T17:06:10.310 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-06-11T17:06:10.310 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-06-11T17:06:10.310 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-06-11T17:06:10.403 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-112-generic 2024-06-11T17:06:10.403 DEBUG:teuthology.orchestra.run.smithi172:> sudo update-grub 2024-06-11T17:06:11.852 INFO:teuthology.orchestra.run.smithi172.stderr:Sourcing file `/etc/default/grub' 2024-06-11T17:06:11.854 INFO:teuthology.orchestra.run.smithi172.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-06-11T17:06:11.858 INFO:teuthology.orchestra.run.smithi172.stderr:Generating grub configuration file ... 2024-06-11T17:06:12.092 INFO:teuthology.orchestra.run.smithi172.stderr:Found linux image: /boot/vmlinuz-5.15.0-112-generic 2024-06-11T17:06:12.097 INFO:teuthology.orchestra.run.smithi172.stderr:Found initrd image: /boot/initrd.img-5.15.0-112-generic 2024-06-11T17:06:12.340 INFO:teuthology.orchestra.run.smithi172.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-06-11T17:06:12.345 INFO:teuthology.orchestra.run.smithi172.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-06-11T17:06:12.385 INFO:teuthology.orchestra.run.smithi172.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-06-11T17:06:12.391 INFO:teuthology.orchestra.run.smithi172.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-06-11T17:06:12.521 INFO:teuthology.orchestra.run.smithi172.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-06-11T17:06:12.521 INFO:teuthology.orchestra.run.smithi172.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-06-11T17:06:12.521 INFO:teuthology.orchestra.run.smithi172.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-06-11T17:06:12.557 INFO:teuthology.orchestra.run.smithi172.stderr:done 2024-06-11T17:06:12.566 DEBUG:teuthology.orchestra.run.smithi172:> sudo shutdown -r now 2024-06-11T17:06:25.951 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.130 2024-06-11T17:06:34.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-06-11T17:06:34.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T17:06:38.014 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.130 2024-06-11T17:06:42.617 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-06-11T17:06:42.618 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-06-11T17:06:42.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T17:06:50.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-06-11T17:06:50.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T17:07:01.026 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-06-11T17:07:10.034 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-06-11T17:07:10.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T17:07:13.086 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-06-11T17:07:22.088 DEBUG:teuthology.orchestra.run.smithi130:> true 2024-06-11T17:07:22.597 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-06-11T17:07:22.597 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-112-generic"... 2024-06-11T17:07:22.597 DEBUG:teuthology.orchestra.run.smithi130:> uname -r 2024-06-11T17:07:22.643 INFO:teuthology.orchestra.run.smithi130.stdout:5.15.0-112-generic 2024-06-11T17:07:22.643 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-112-generic vs 5.15.0-112-generic 2024-06-11T17:07:22.643 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-06-11T17:07:22.643 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-06-11T17:07:23.644 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-06-11T17:07:23.645 DEBUG:teuthology.orchestra.run.smithi130:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-06-11T17:07:23.740 INFO:teuthology.orchestra.run.smithi130.stdout:ttyS1 2024-06-11T17:07:23.780 DEBUG:teuthology.parallel:result is None 2024-06-11T17:07:25.088 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-06-11T17:07:25.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T17:07:43.519 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-06-11T17:07:58.520 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-06-11T17:07:58.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T17:07:58.523 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-06-11T17:08:16.523 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-06-11T17:08:16.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T17:08:16.879 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-06-11T17:08:17.491 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-06-11T17:08:17.492 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-112-generic"... 2024-06-11T17:08:17.492 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2024-06-11T17:08:17.540 INFO:teuthology.orchestra.run.smithi172.stdout:5.15.0-112-generic 2024-06-11T17:08:17.541 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-112-generic vs 5.15.0-112-generic 2024-06-11T17:08:17.541 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-06-11T17:08:17.541 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-06-11T17:08:18.542 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-06-11T17:08:18.542 DEBUG:teuthology.orchestra.run.smithi172:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-06-11T17:08:18.865 INFO:teuthology.orchestra.run.smithi172.stdout:ttyS1 2024-06-11T17:08:18.886 DEBUG:teuthology.parallel:result is None 2024-06-11T17:08:18.887 INFO:teuthology.run_tasks:Running task internal.base... 2024-06-11T17:08:18.895 INFO:teuthology.task.internal:Creating test directory... 2024-06-11T17:08:18.895 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-11T17:08:18.898 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-11T17:08:18.904 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-06-11T17:08:18.917 INFO:teuthology.run_tasks:Running task internal.archive... 2024-06-11T17:08:18.930 INFO:teuthology.task.internal:Creating archive directory... 2024-06-11T17:08:18.930 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-11T17:08:18.947 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-11T17:08:18.971 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-06-11T17:08:18.979 INFO:teuthology.task.internal:Enabling coredump saving... 2024-06-11T17:08:18.980 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-11T17:08:19.007 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-11T17:08:19.025 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-11T17:08:19.029 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-11T17:08:19.035 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-11T17:08:19.037 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-11T17:08:19.038 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-06-11T17:08:19.047 INFO:teuthology.task.internal:Configuring sudo... 2024-06-11T17:08:19.047 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-11T17:08:19.079 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-11T17:08:19.093 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-06-11T17:08:19.104 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-06-11T17:08:19.104 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-11T17:08:19.135 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-11T17:08:19.140 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-11T17:08:19.186 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-11T17:08:19.234 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-06-11T17:08:19.234 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-11T17:08:19.301 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-11T17:08:19.306 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-11T17:08:19.353 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-06-11T17:08:19.353 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-11T17:08:19.439 DEBUG:teuthology.orchestra.run.smithi130:> sudo service rsyslog restart 2024-06-11T17:08:19.441 DEBUG:teuthology.orchestra.run.smithi172:> sudo service rsyslog restart 2024-06-11T17:08:19.521 INFO:teuthology.run_tasks:Running task internal.timer... 2024-06-11T17:08:19.528 INFO:teuthology.task.internal:Starting timer... 2024-06-11T17:08:19.528 INFO:teuthology.run_tasks:Running task pcp... 2024-06-11T17:08:19.545 INFO:teuthology.run_tasks:Running task selinux... 2024-06-11T17:08:19.559 DEBUG:teuthology.task.selinux:Excluding smithi130: OS 'ubuntu' does not support SELinux 2024-06-11T17:08:19.560 DEBUG:teuthology.task.selinux:Excluding smithi172: OS 'ubuntu' does not support SELinux 2024-06-11T17:08:19.560 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-06-11T17:08:19.560 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-06-11T17:08:19.560 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-06-11T17:08:19.560 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-06-11T17:08:19.575 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-06-11T17:08:19.577 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-06-11T17:08:19.685 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-06-11T17:08:19.695 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-06-11T17:08:19.696 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi130.front.sepia.ceph.com,smithi172.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-06-11T17:15:17.956 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi130.front.sepia.ceph.com'), Remote(name='ubuntu@smithi172.front.sepia.ceph.com')] 2024-06-11T17:15:17.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-06-11T17:15:17.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T17:15:18.042 DEBUG:teuthology.orchestra.run.smithi130:> true 2024-06-11T17:15:18.122 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-06-11T17:15:18.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-06-11T17:15:18.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T17:15:18.207 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-06-11T17:15:18.286 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-06-11T17:15:18.287 INFO:teuthology.run_tasks:Running task clock... 2024-06-11T17:15:18.300 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-06-11T17:15:18.300 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-11T17:15:18.301 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-11T17:15:18.303 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-11T17:15:18.304 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-11T17:15:18.328 INFO:teuthology.orchestra.run.smithi130.stdout:11 Jun 17:15:18 ntpd[17570]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-06-11T17:15:18.329 INFO:teuthology.orchestra.run.smithi130.stdout:11 Jun 17:15:18 ntpd[17570]: Command line: ntpd -gq 2024-06-11T17:15:18.329 INFO:teuthology.orchestra.run.smithi130.stdout:11 Jun 17:15:18 ntpd[17570]: ---------------------------------------------------- 2024-06-11T17:15:18.329 INFO:teuthology.orchestra.run.smithi130.stdout:11 Jun 17:15:18 ntpd[17570]: ntp-4 is maintained by Network Time Foundation, 2024-06-11T17:15:18.329 INFO:teuthology.orchestra.run.smithi130.stdout:11 Jun 17:15:18 ntpd[17570]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-06-11T17:15:18.329 INFO:teuthology.orchestra.run.smithi130.stdout:11 Jun 17:15:18 ntpd[17570]: corporation. Support and training for ntp-4 are 2024-06-11T17:15:18.329 INFO:teuthology.orchestra.run.smithi130.stdout:11 Jun 17:15:18 ntpd[17570]: available at https://www.nwtime.org/support 2024-06-11T17:15:18.329 INFO:teuthology.orchestra.run.smithi130.stdout:11 Jun 17:15:18 ntpd[17570]: ---------------------------------------------------- 2024-06-11T17:15:18.329 INFO:teuthology.orchestra.run.smithi130.stdout:11 Jun 17:15:18 ntpd[17570]: proto: precision = 0.062 usec (-24) 2024-06-11T17:15:18.330 INFO:teuthology.orchestra.run.smithi130.stdout:11 Jun 17:15:18 ntpd[17570]: basedate set to 2022-02-04 2024-06-11T17:15:18.331 INFO:teuthology.orchestra.run.smithi130.stdout:11 Jun 17:15:18 ntpd[17570]: gps base set to 2022-02-06 (week 2196) 2024-06-11T17:15:18.331 INFO:teuthology.orchestra.run.smithi130.stdout:11 Jun 17:15:18 ntpd[17570]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-06-11T17:15:18.331 INFO:teuthology.orchestra.run.smithi130.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-06-11T17:15:18.331 INFO:teuthology.orchestra.run.smithi130.stderr:restrict ::: KOD does nothing without LIMITED. 2024-06-11T17:15:18.332 INFO:teuthology.orchestra.run.smithi130.stdout:11 Jun 17:15:18 ntpd[17570]: restrict ::: KOD does nothing without LIMITED. 2024-06-11T17:15:18.332 INFO:teuthology.orchestra.run.smithi130.stdout:11 Jun 17:15:18 ntpd[17570]: Listen and drop on 0 v6wildcard [::]:123 2024-06-11T17:15:18.332 INFO:teuthology.orchestra.run.smithi130.stdout:11 Jun 17:15:18 ntpd[17570]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-06-11T17:15:18.332 INFO:teuthology.orchestra.run.smithi130.stdout:11 Jun 17:15:18 ntpd[17570]: Listen normally on 2 lo 127.0.0.1:123 2024-06-11T17:15:18.332 INFO:teuthology.orchestra.run.smithi130.stdout:11 Jun 17:15:18 ntpd[17570]: Listen normally on 3 enp3s0f1 172.21.15.130:123 2024-06-11T17:15:18.332 INFO:teuthology.orchestra.run.smithi130.stdout:11 Jun 17:15:18 ntpd[17570]: Listen normally on 4 lo [::1]:123 2024-06-11T17:15:18.333 INFO:teuthology.orchestra.run.smithi130.stdout:11 Jun 17:15:18 ntpd[17570]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f37%5]:123 2024-06-11T17:15:18.333 INFO:teuthology.orchestra.run.smithi130.stdout:11 Jun 17:15:18 ntpd[17570]: Listening on routing socket on fd #22 for interface updates 2024-06-11T17:15:18.354 INFO:teuthology.orchestra.run.smithi172.stdout:11 Jun 17:15:18 ntpd[17592]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-06-11T17:15:18.354 INFO:teuthology.orchestra.run.smithi172.stdout:11 Jun 17:15:18 ntpd[17592]: Command line: ntpd -gq 2024-06-11T17:15:18.354 INFO:teuthology.orchestra.run.smithi172.stdout:11 Jun 17:15:18 ntpd[17592]: ---------------------------------------------------- 2024-06-11T17:15:18.355 INFO:teuthology.orchestra.run.smithi172.stdout:11 Jun 17:15:18 ntpd[17592]: ntp-4 is maintained by Network Time Foundation, 2024-06-11T17:15:18.355 INFO:teuthology.orchestra.run.smithi172.stdout:11 Jun 17:15:18 ntpd[17592]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-06-11T17:15:18.355 INFO:teuthology.orchestra.run.smithi172.stdout:11 Jun 17:15:18 ntpd[17592]: corporation. Support and training for ntp-4 are 2024-06-11T17:15:18.355 INFO:teuthology.orchestra.run.smithi172.stdout:11 Jun 17:15:18 ntpd[17592]: available at https://www.nwtime.org/support 2024-06-11T17:15:18.355 INFO:teuthology.orchestra.run.smithi172.stdout:11 Jun 17:15:18 ntpd[17592]: ---------------------------------------------------- 2024-06-11T17:15:18.355 INFO:teuthology.orchestra.run.smithi172.stdout:11 Jun 17:15:18 ntpd[17592]: proto: precision = 0.057 usec (-24) 2024-06-11T17:15:18.356 INFO:teuthology.orchestra.run.smithi172.stdout:11 Jun 17:15:18 ntpd[17592]: basedate set to 2022-02-04 2024-06-11T17:15:18.356 INFO:teuthology.orchestra.run.smithi172.stdout:11 Jun 17:15:18 ntpd[17592]: gps base set to 2022-02-06 (week 2196) 2024-06-11T17:15:18.356 INFO:teuthology.orchestra.run.smithi172.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-06-11T17:15:18.356 INFO:teuthology.orchestra.run.smithi172.stdout:11 Jun 17:15:18 ntpd[17592]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-06-11T17:15:18.356 INFO:teuthology.orchestra.run.smithi172.stdout:11 Jun 17:15:18 ntpd[17592]: restrict ::: KOD does nothing without LIMITED. 2024-06-11T17:15:18.357 INFO:teuthology.orchestra.run.smithi172.stderr:restrict ::: KOD does nothing without LIMITED. 2024-06-11T17:15:18.357 INFO:teuthology.orchestra.run.smithi172.stdout:11 Jun 17:15:18 ntpd[17592]: Listen and drop on 0 v6wildcard [::]:123 2024-06-11T17:15:18.357 INFO:teuthology.orchestra.run.smithi172.stdout:11 Jun 17:15:18 ntpd[17592]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-06-11T17:15:18.358 INFO:teuthology.orchestra.run.smithi172.stdout:11 Jun 17:15:18 ntpd[17592]: Listen normally on 2 lo 127.0.0.1:123 2024-06-11T17:15:18.358 INFO:teuthology.orchestra.run.smithi172.stdout:11 Jun 17:15:18 ntpd[17592]: Listen normally on 3 enp3s0f1 172.21.15.172:123 2024-06-11T17:15:18.358 INFO:teuthology.orchestra.run.smithi172.stdout:11 Jun 17:15:18 ntpd[17592]: Listen normally on 4 lo [::1]:123 2024-06-11T17:15:18.358 INFO:teuthology.orchestra.run.smithi172.stdout:11 Jun 17:15:18 ntpd[17592]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f91%5]:123 2024-06-11T17:15:18.358 INFO:teuthology.orchestra.run.smithi172.stdout:11 Jun 17:15:18 ntpd[17592]: Listening on routing socket on fd #22 for interface updates 2024-06-11T17:15:19.355 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:19 ntpd[17592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:19.355 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:19 ntpd[17592]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:19.355 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:19 ntpd[17592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:19.355 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:19 ntpd[17592]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:19.355 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:19 ntpd[17592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:19.355 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:19 ntpd[17592]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:19.355 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:19 ntpd[17592]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-06-11T17:15:19.355 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:19 ntpd[17592]: can't open /var/log/ntpstats/peerstats.20240611: Permission denied 2024-06-11T17:15:21.329 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:21 ntpd[17570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:21.329 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:21 ntpd[17570]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:21.329 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:21 ntpd[17570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:21.329 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:21 ntpd[17570]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:21.329 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:21 ntpd[17570]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-06-11T17:15:21.329 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:21 ntpd[17570]: can't open /var/log/ntpstats/peerstats.20240611: Permission denied 2024-06-11T17:15:21.355 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:21 ntpd[17592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:21.355 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:21 ntpd[17592]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:21.356 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:21 ntpd[17592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:21.356 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:21 ntpd[17592]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:21.356 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:21 ntpd[17592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:21.356 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:21 ntpd[17592]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:21.356 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:21 ntpd[17592]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-06-11T17:15:21.356 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:21 ntpd[17592]: can't open /var/log/ntpstats/peerstats.20240611: Permission denied 2024-06-11T17:15:21.356 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:21 ntpd[17592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:21.356 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:21 ntpd[17592]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:21.356 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:21 ntpd[17592]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-06-11T17:15:21.356 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:21 ntpd[17592]: can't open /var/log/ntpstats/peerstats.20240611: Permission denied 2024-06-11T17:15:22.329 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:22 ntpd[17570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:22.329 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:22 ntpd[17570]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:22.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:22 ntpd[17570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:22.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:22 ntpd[17570]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:22.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:22 ntpd[17570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:22.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:22 ntpd[17570]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:22.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:22 ntpd[17570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:22.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:22 ntpd[17570]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:22.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:22 ntpd[17570]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-06-11T17:15:22.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:22 ntpd[17570]: can't open /var/log/ntpstats/peerstats.20240611: Permission denied 2024-06-11T17:15:22.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:22 ntpd[17570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:22.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:22 ntpd[17570]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:22.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:22 ntpd[17570]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-06-11T17:15:22.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:22 ntpd[17570]: can't open /var/log/ntpstats/peerstats.20240611: Permission denied 2024-06-11T17:15:23.329 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:23 ntpd[17570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:23.329 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:23 ntpd[17570]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:23.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:23 ntpd[17570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:23.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:23 ntpd[17570]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:23.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:23 ntpd[17570]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-06-11T17:15:23.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:23 ntpd[17570]: can't open /var/log/ntpstats/peerstats.20240611: Permission denied 2024-06-11T17:15:23.356 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:23 ntpd[17592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:23.356 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:23 ntpd[17592]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:23.356 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:23 ntpd[17592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:23.356 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:23 ntpd[17592]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:23.356 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:23 ntpd[17592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:23.356 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:23 ntpd[17592]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:23.356 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:23 ntpd[17592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:23.356 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:23 ntpd[17592]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:23.356 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:23 ntpd[17592]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-06-11T17:15:23.357 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:23 ntpd[17592]: can't open /var/log/ntpstats/peerstats.20240611: Permission denied 2024-06-11T17:15:23.357 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:23 ntpd[17592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:23.357 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:23 ntpd[17592]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:23.357 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:23 ntpd[17592]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-06-11T17:15:23.357 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:23 ntpd[17592]: can't open /var/log/ntpstats/peerstats.20240611: Permission denied 2024-06-11T17:15:23.357 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:23 ntpd[17592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:23.357 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:23 ntpd[17592]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:23.357 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:23 ntpd[17592]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-06-11T17:15:23.357 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:23 ntpd[17592]: can't open /var/log/ntpstats/peerstats.20240611: Permission denied 2024-06-11T17:15:24.329 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:24 ntpd[17570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:24.329 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:24 ntpd[17570]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:24.329 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:24 ntpd[17570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:24.329 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:24 ntpd[17570]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:24.329 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:24 ntpd[17570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:24.329 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:24 ntpd[17570]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:24.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:24 ntpd[17570]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-06-11T17:15:24.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:24 ntpd[17570]: can't open /var/log/ntpstats/peerstats.20240611: Permission denied 2024-06-11T17:15:24.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:24 ntpd[17570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:24.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:24 ntpd[17570]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:24.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:24 ntpd[17570]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-06-11T17:15:24.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:24 ntpd[17570]: can't open /var/log/ntpstats/peerstats.20240611: Permission denied 2024-06-11T17:15:25.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:25 ntpd[17570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:25.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:25 ntpd[17570]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:25.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:25 ntpd[17570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:25.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:25 ntpd[17570]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:25.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:25 ntpd[17570]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-06-11T17:15:25.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:25 ntpd[17570]: can't open /var/log/ntpstats/peerstats.20240611: Permission denied 2024-06-11T17:15:25.355 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:25 ntpd[17592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:25.355 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:25 ntpd[17592]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:25.355 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:25 ntpd[17592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:25.355 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:25 ntpd[17592]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:25.355 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:25 ntpd[17592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:25.355 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:25 ntpd[17592]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:25.355 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:25 ntpd[17592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:25.356 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:25 ntpd[17592]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:25.356 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:25 ntpd[17592]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-06-11T17:15:25.356 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:25 ntpd[17592]: can't open /var/log/ntpstats/peerstats.20240611: Permission denied 2024-06-11T17:15:25.356 INFO:teuthology.orchestra.run.smithi172.stdout:11 Jun 17:15:25 ntpd[17592]: ntpd: time slew -0.001580 s 2024-06-11T17:15:25.356 INFO:teuthology.orchestra.run.smithi172.stdout:ntpd: time slew -0.001580s 2024-06-11T17:15:25.356 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:25 ntpd[17592]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-06-11T17:15:25.356 INFO:teuthology.orchestra.run.smithi172.stderr:11 Jun 17:15:25 ntpd[17592]: can't open /var/log/ntpstats/loopstats.20240611: Permission denied 2024-06-11T17:15:25.413 INFO:teuthology.orchestra.run.smithi172.stdout: remote refid st t when poll reach delay offset jitter 2024-06-11T17:15:25.413 INFO:teuthology.orchestra.run.smithi172.stdout:============================================================================== 2024-06-11T17:15:25.413 INFO:teuthology.orchestra.run.smithi172.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-06-11T17:15:25.413 INFO:teuthology.orchestra.run.smithi172.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-06-11T17:15:25.413 INFO:teuthology.orchestra.run.smithi172.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-06-11T17:15:25.413 INFO:teuthology.orchestra.run.smithi172.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-06-11T17:15:26.329 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:26 ntpd[17570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:26.329 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:26 ntpd[17570]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:26.329 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:26 ntpd[17570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:26.329 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:26 ntpd[17570]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:26.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:26 ntpd[17570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:26.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:26 ntpd[17570]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:26.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:26 ntpd[17570]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-06-11T17:15:26.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:26 ntpd[17570]: can't open /var/log/ntpstats/peerstats.20240611: Permission denied 2024-06-11T17:15:26.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:26 ntpd[17570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:26.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:26 ntpd[17570]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:26.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:26 ntpd[17570]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-06-11T17:15:26.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:26 ntpd[17570]: can't open /var/log/ntpstats/peerstats.20240611: Permission denied 2024-06-11T17:15:27.329 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:27 ntpd[17570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:27.329 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:27 ntpd[17570]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:27.329 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:27 ntpd[17570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-06-11T17:15:27.329 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:27 ntpd[17570]: can't open /var/log/ntpstats/rawstats.20240611: Permission denied 2024-06-11T17:15:27.329 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:27 ntpd[17570]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-06-11T17:15:27.330 INFO:teuthology.orchestra.run.smithi130.stdout:11 Jun 17:15:27 ntpd[17570]: ntpd: time slew -0.002176 s 2024-06-11T17:15:27.330 INFO:teuthology.orchestra.run.smithi130.stdout:ntpd: time slew -0.002176s 2024-06-11T17:15:27.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:27 ntpd[17570]: can't open /var/log/ntpstats/peerstats.20240611: Permission denied 2024-06-11T17:15:27.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:27 ntpd[17570]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-06-11T17:15:27.330 INFO:teuthology.orchestra.run.smithi130.stderr:11 Jun 17:15:27 ntpd[17570]: can't open /var/log/ntpstats/loopstats.20240611: Permission denied 2024-06-11T17:15:27.384 INFO:teuthology.orchestra.run.smithi130.stdout: remote refid st t when poll reach delay offset jitter 2024-06-11T17:15:27.384 INFO:teuthology.orchestra.run.smithi130.stdout:============================================================================== 2024-06-11T17:15:27.384 INFO:teuthology.orchestra.run.smithi130.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-06-11T17:15:27.384 INFO:teuthology.orchestra.run.smithi130.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-06-11T17:15:27.384 INFO:teuthology.orchestra.run.smithi130.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-06-11T17:15:27.384 INFO:teuthology.orchestra.run.smithi130.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-06-11T17:15:27.384 INFO:teuthology.run_tasks:Running task install... 2024-06-11T17:15:27.392 DEBUG:teuthology.task.install:project ceph 2024-06-11T17:15:27.393 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '37bbe1d8d788b7c9a71280e7d510c295a5853f0b'}} 2024-06-11T17:15:27.393 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['sqlite3'], 'rpm': ['sqlite-devel']}, 'flavor': 'default', 'sha1': '37bbe1d8d788b7c9a71280e7d510c295a5853f0b'} 2024-06-11T17:15:27.393 INFO:teuthology.task.install:Using flavor: default 2024-06-11T17:15:27.399 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-06-11T17:15:27.400 INFO:teuthology.task.install:extra packages: [] 2024-06-11T17:15:27.400 DEBUG:teuthology.orchestra.run.smithi130:> sudo apt-key list | grep Ceph 2024-06-11T17:15:27.401 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-key list | grep Ceph 2024-06-11T17:15:27.463 INFO:teuthology.orchestra.run.smithi172.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-06-11T17:15:27.479 INFO:teuthology.orchestra.run.smithi130.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-06-11T17:15:27.492 INFO:teuthology.orchestra.run.smithi172.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-06-11T17:15:27.492 INFO:teuthology.orchestra.run.smithi172.stdout:uid [ unknown] Ceph.com (release key) 2024-06-11T17:15:27.492 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-06-11T17:15:27.492 INFO:teuthology.task.install.deb:Installing system (non-project) packages: sqlite3 on remote deb x86_64 2024-06-11T17:15:27.493 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=37bbe1d8d788b7c9a71280e7d510c295a5853f0b 2024-06-11T17:15:27.505 INFO:teuthology.orchestra.run.smithi130.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-06-11T17:15:27.505 INFO:teuthology.orchestra.run.smithi130.stdout:uid [ unknown] Ceph.com (release key) 2024-06-11T17:15:27.505 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-06-11T17:15:27.505 INFO:teuthology.task.install.deb:Installing system (non-project) packages: sqlite3 on remote deb x86_64 2024-06-11T17:15:27.505 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=37bbe1d8d788b7c9a71280e7d510c295a5853f0b 2024-06-11T17:15:27.649 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default/ 2024-06-11T17:15:27.649 INFO:teuthology.task.install.deb:Package version is 19.0.0-4216-g37bbe1d8-1jammy 2024-06-11T17:15:27.711 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default/ 2024-06-11T17:15:27.711 INFO:teuthology.task.install.deb:Package version is 19.0.0-4216-g37bbe1d8-1jammy 2024-06-11T17:15:27.903 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-06-11T17:15:27.903 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-06-11T17:15:27.916 DEBUG:teuthology.orchestra.run.smithi130:> sudo apt-get update 2024-06-11T17:15:27.979 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-06-11T17:15:27.979 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-06-11T17:15:27.993 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-get update 2024-06-11T17:15:28.084 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-06-11T17:15:28.085 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-06-11T17:15:28.098 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-06-11T17:15:28.118 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-06-11T17:15:28.170 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-06-11T17:15:28.182 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-06-11T17:15:28.203 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-06-11T17:15:28.249 INFO:teuthology.orchestra.run.smithi130.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy InRelease 2024-06-11T17:15:28.275 INFO:teuthology.orchestra.run.smithi172.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy InRelease 2024-06-11T17:15:28.300 INFO:teuthology.orchestra.run.smithi130.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy Release [7,653 B] 2024-06-11T17:15:28.311 INFO:teuthology.orchestra.run.smithi172.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy Release [7,653 B] 2024-06-11T17:15:28.348 INFO:teuthology.orchestra.run.smithi172.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy Release.gpg 2024-06-11T17:15:28.351 INFO:teuthology.orchestra.run.smithi130.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy Release.gpg 2024-06-11T17:15:28.376 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:7 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-06-11T17:15:28.385 INFO:teuthology.orchestra.run.smithi172.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-06-11T17:15:28.404 INFO:teuthology.orchestra.run.smithi130.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,423 B] 2024-06-11T17:15:28.430 INFO:teuthology.orchestra.run.smithi172.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,423 B] 2024-06-11T17:15:28.464 INFO:teuthology.orchestra.run.smithi130.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-06-11T17:15:28.533 INFO:teuthology.orchestra.run.smithi172.stdout:Fetched 29.2 kB in 0s (81.8 kB/s) 2024-06-11T17:15:28.598 INFO:teuthology.orchestra.run.smithi130.stdout:Fetched 29.2 kB in 1s (58.3 kB/s) 2024-06-11T17:15:29.521 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2024-06-11T17:15:29.538 DEBUG:teuthology.orchestra.run.smithi172:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-4216-g37bbe1d8-1jammy cephadm=19.0.0-4216-g37bbe1d8-1jammy ceph-mds=19.0.0-4216-g37bbe1d8-1jammy ceph-mgr=19.0.0-4216-g37bbe1d8-1jammy ceph-common=19.0.0-4216-g37bbe1d8-1jammy ceph-fuse=19.0.0-4216-g37bbe1d8-1jammy ceph-test=19.0.0-4216-g37bbe1d8-1jammy ceph-volume=19.0.0-4216-g37bbe1d8-1jammy radosgw=19.0.0-4216-g37bbe1d8-1jammy python3-rados=19.0.0-4216-g37bbe1d8-1jammy python3-rgw=19.0.0-4216-g37bbe1d8-1jammy python3-cephfs=19.0.0-4216-g37bbe1d8-1jammy python3-rbd=19.0.0-4216-g37bbe1d8-1jammy libcephfs2=19.0.0-4216-g37bbe1d8-1jammy libcephfs-dev=19.0.0-4216-g37bbe1d8-1jammy librados2=19.0.0-4216-g37bbe1d8-1jammy librbd1=19.0.0-4216-g37bbe1d8-1jammy rbd-fuse=19.0.0-4216-g37bbe1d8-1jammy 2024-06-11T17:15:29.572 INFO:teuthology.orchestra.run.smithi130.stdout:Reading package lists... 2024-06-11T17:15:29.589 DEBUG:teuthology.orchestra.run.smithi130:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-4216-g37bbe1d8-1jammy cephadm=19.0.0-4216-g37bbe1d8-1jammy ceph-mds=19.0.0-4216-g37bbe1d8-1jammy ceph-mgr=19.0.0-4216-g37bbe1d8-1jammy ceph-common=19.0.0-4216-g37bbe1d8-1jammy ceph-fuse=19.0.0-4216-g37bbe1d8-1jammy ceph-test=19.0.0-4216-g37bbe1d8-1jammy ceph-volume=19.0.0-4216-g37bbe1d8-1jammy radosgw=19.0.0-4216-g37bbe1d8-1jammy python3-rados=19.0.0-4216-g37bbe1d8-1jammy python3-rgw=19.0.0-4216-g37bbe1d8-1jammy python3-cephfs=19.0.0-4216-g37bbe1d8-1jammy python3-rbd=19.0.0-4216-g37bbe1d8-1jammy libcephfs2=19.0.0-4216-g37bbe1d8-1jammy libcephfs-dev=19.0.0-4216-g37bbe1d8-1jammy librados2=19.0.0-4216-g37bbe1d8-1jammy librbd1=19.0.0-4216-g37bbe1d8-1jammy rbd-fuse=19.0.0-4216-g37bbe1d8-1jammy 2024-06-11T17:15:29.602 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2024-06-11T17:15:29.643 INFO:teuthology.orchestra.run.smithi130.stdout:Reading package lists... 2024-06-11T17:15:29.803 INFO:teuthology.orchestra.run.smithi172.stdout:Building dependency tree... 2024-06-11T17:15:29.804 INFO:teuthology.orchestra.run.smithi172.stdout:Reading state information... 2024-06-11T17:15:29.829 INFO:teuthology.orchestra.run.smithi130.stdout:Building dependency tree... 2024-06-11T17:15:29.830 INFO:teuthology.orchestra.run.smithi130.stdout:Reading state information... 2024-06-11T17:15:30.004 INFO:teuthology.orchestra.run.smithi172.stdout:The following packages were automatically installed and are no longer required: 2024-06-11T17:15:30.005 INFO:teuthology.orchestra.run.smithi172.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-06-11T17:15:30.005 INFO:teuthology.orchestra.run.smithi172.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-06-11T17:15:30.005 INFO:teuthology.orchestra.run.smithi172.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-06-11T17:15:30.005 INFO:teuthology.orchestra.run.smithi172.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-06-11T17:15:30.005 INFO:teuthology.orchestra.run.smithi172.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-06-11T17:15:30.006 INFO:teuthology.orchestra.run.smithi172.stdout:Use 'sudo apt autoremove' to remove them. 2024-06-11T17:15:30.006 INFO:teuthology.orchestra.run.smithi172.stdout:The following additional packages will be installed: 2024-06-11T17:15:30.006 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-06-11T17:15:30.006 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-06-11T17:15:30.008 INFO:teuthology.orchestra.run.smithi172.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-06-11T17:15:30.008 INFO:teuthology.orchestra.run.smithi172.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-06-11T17:15:30.008 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-06-11T17:15:30.008 INFO:teuthology.orchestra.run.smithi172.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-06-11T17:15:30.008 INFO:teuthology.orchestra.run.smithi172.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-06-11T17:15:30.008 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-06-11T17:15:30.008 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-06-11T17:15:30.008 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-06-11T17:15:30.008 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-06-11T17:15:30.008 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-06-11T17:15:30.008 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-06-11T17:15:30.009 INFO:teuthology.orchestra.run.smithi172.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-06-11T17:15:30.009 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-06-11T17:15:30.009 INFO:teuthology.orchestra.run.smithi172.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-06-11T17:15:30.009 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-06-11T17:15:30.009 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-06-11T17:15:30.009 INFO:teuthology.orchestra.run.smithi172.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-06-11T17:15:30.009 INFO:teuthology.orchestra.run.smithi172.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-06-11T17:15:30.009 INFO:teuthology.orchestra.run.smithi172.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-06-11T17:15:30.009 INFO:teuthology.orchestra.run.smithi172.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-06-11T17:15:30.009 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-06-11T17:15:30.009 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet zip 2024-06-11T17:15:30.010 INFO:teuthology.orchestra.run.smithi172.stdout:Suggested packages: 2024-06-11T17:15:30.010 INFO:teuthology.orchestra.run.smithi172.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-06-11T17:15:30.010 INFO:teuthology.orchestra.run.smithi172.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-06-11T17:15:30.010 INFO:teuthology.orchestra.run.smithi172.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-06-11T17:15:30.010 INFO:teuthology.orchestra.run.smithi172.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-06-11T17:15:30.010 INFO:teuthology.orchestra.run.smithi172.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-06-11T17:15:30.011 INFO:teuthology.orchestra.run.smithi172.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-06-11T17:15:30.011 INFO:teuthology.orchestra.run.smithi172.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-06-11T17:15:30.011 INFO:teuthology.orchestra.run.smithi172.stdout:Recommended packages: 2024-06-11T17:15:30.011 INFO:teuthology.orchestra.run.smithi172.stdout: btrfs-tools 2024-06-11T17:15:30.012 INFO:teuthology.orchestra.run.smithi130.stdout:The following packages were automatically installed and are no longer required: 2024-06-11T17:15:30.013 INFO:teuthology.orchestra.run.smithi130.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-06-11T17:15:30.013 INFO:teuthology.orchestra.run.smithi130.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-06-11T17:15:30.013 INFO:teuthology.orchestra.run.smithi130.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-06-11T17:15:30.013 INFO:teuthology.orchestra.run.smithi130.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-06-11T17:15:30.013 INFO:teuthology.orchestra.run.smithi130.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-06-11T17:15:30.013 INFO:teuthology.orchestra.run.smithi130.stdout:Use 'sudo apt autoremove' to remove them. 2024-06-11T17:15:30.013 INFO:teuthology.orchestra.run.smithi130.stdout:The following additional packages will be installed: 2024-06-11T17:15:30.013 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-06-11T17:15:30.013 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-06-11T17:15:30.013 INFO:teuthology.orchestra.run.smithi130.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-06-11T17:15:30.013 INFO:teuthology.orchestra.run.smithi130.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-06-11T17:15:30.013 INFO:teuthology.orchestra.run.smithi130.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-06-11T17:15:30.013 INFO:teuthology.orchestra.run.smithi130.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-06-11T17:15:30.014 INFO:teuthology.orchestra.run.smithi130.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-06-11T17:15:30.014 INFO:teuthology.orchestra.run.smithi130.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-06-11T17:15:30.014 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-06-11T17:15:30.014 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-06-11T17:15:30.014 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-06-11T17:15:30.014 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-06-11T17:15:30.014 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-06-11T17:15:30.014 INFO:teuthology.orchestra.run.smithi130.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-06-11T17:15:30.014 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-06-11T17:15:30.014 INFO:teuthology.orchestra.run.smithi130.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-06-11T17:15:30.014 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-06-11T17:15:30.014 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-06-11T17:15:30.014 INFO:teuthology.orchestra.run.smithi130.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-06-11T17:15:30.014 INFO:teuthology.orchestra.run.smithi130.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-06-11T17:15:30.015 INFO:teuthology.orchestra.run.smithi130.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-06-11T17:15:30.015 INFO:teuthology.orchestra.run.smithi130.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-06-11T17:15:30.015 INFO:teuthology.orchestra.run.smithi130.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-06-11T17:15:30.015 INFO:teuthology.orchestra.run.smithi130.stdout: xmlstarlet zip 2024-06-11T17:15:30.015 INFO:teuthology.orchestra.run.smithi130.stdout:Suggested packages: 2024-06-11T17:15:30.015 INFO:teuthology.orchestra.run.smithi130.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-06-11T17:15:30.015 INFO:teuthology.orchestra.run.smithi130.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-06-11T17:15:30.015 INFO:teuthology.orchestra.run.smithi130.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-06-11T17:15:30.015 INFO:teuthology.orchestra.run.smithi130.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-06-11T17:15:30.015 INFO:teuthology.orchestra.run.smithi130.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-06-11T17:15:30.015 INFO:teuthology.orchestra.run.smithi130.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-06-11T17:15:30.015 INFO:teuthology.orchestra.run.smithi130.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-06-11T17:15:30.015 INFO:teuthology.orchestra.run.smithi130.stdout:Recommended packages: 2024-06-11T17:15:30.016 INFO:teuthology.orchestra.run.smithi130.stdout: btrfs-tools 2024-06-11T17:15:30.110 INFO:teuthology.orchestra.run.smithi172.stdout:The following NEW packages will be installed: 2024-06-11T17:15:30.110 INFO:teuthology.orchestra.run.smithi172.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-06-11T17:15:30.110 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-06-11T17:15:30.110 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-06-11T17:15:30.111 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-06-11T17:15:30.111 INFO:teuthology.orchestra.run.smithi172.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-06-11T17:15:30.111 INFO:teuthology.orchestra.run.smithi172.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-06-11T17:15:30.112 INFO:teuthology.orchestra.run.smithi172.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-06-11T17:15:30.112 INFO:teuthology.orchestra.run.smithi172.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-06-11T17:15:30.112 INFO:teuthology.orchestra.run.smithi172.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-06-11T17:15:30.112 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-06-11T17:15:30.112 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-06-11T17:15:30.112 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-06-11T17:15:30.112 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-06-11T17:15:30.112 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-06-11T17:15:30.112 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-06-11T17:15:30.112 INFO:teuthology.orchestra.run.smithi172.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-06-11T17:15:30.113 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-06-11T17:15:30.113 INFO:teuthology.orchestra.run.smithi172.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-06-11T17:15:30.113 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-06-11T17:15:30.113 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-06-11T17:15:30.113 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-06-11T17:15:30.113 INFO:teuthology.orchestra.run.smithi172.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-06-11T17:15:30.113 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-06-11T17:15:30.113 INFO:teuthology.orchestra.run.smithi172.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-06-11T17:15:30.113 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-06-11T17:15:30.113 INFO:teuthology.orchestra.run.smithi172.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-06-11T17:15:30.115 INFO:teuthology.orchestra.run.smithi130.stdout:The following NEW packages will be installed: 2024-06-11T17:15:30.115 INFO:teuthology.orchestra.run.smithi130.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-06-11T17:15:30.115 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-06-11T17:15:30.115 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-06-11T17:15:30.115 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-06-11T17:15:30.115 INFO:teuthology.orchestra.run.smithi130.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-06-11T17:15:30.115 INFO:teuthology.orchestra.run.smithi130.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-06-11T17:15:30.115 INFO:teuthology.orchestra.run.smithi130.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-06-11T17:15:30.115 INFO:teuthology.orchestra.run.smithi130.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-06-11T17:15:30.115 INFO:teuthology.orchestra.run.smithi130.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-06-11T17:15:30.116 INFO:teuthology.orchestra.run.smithi130.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-06-11T17:15:30.116 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-06-11T17:15:30.116 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-06-11T17:15:30.116 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-06-11T17:15:30.116 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-06-11T17:15:30.116 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-06-11T17:15:30.116 INFO:teuthology.orchestra.run.smithi130.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-06-11T17:15:30.116 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-06-11T17:15:30.116 INFO:teuthology.orchestra.run.smithi130.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-06-11T17:15:30.116 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-06-11T17:15:30.116 INFO:teuthology.orchestra.run.smithi130.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-06-11T17:15:30.116 INFO:teuthology.orchestra.run.smithi130.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-06-11T17:15:30.116 INFO:teuthology.orchestra.run.smithi130.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-06-11T17:15:30.116 INFO:teuthology.orchestra.run.smithi130.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-06-11T17:15:30.117 INFO:teuthology.orchestra.run.smithi130.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-06-11T17:15:30.117 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-06-11T17:15:30.117 INFO:teuthology.orchestra.run.smithi130.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-06-11T17:15:30.193 INFO:teuthology.orchestra.run.smithi172.stdout:0 upgraded, 118 newly installed, 0 to remove and 311 not upgraded. 2024-06-11T17:15:30.193 INFO:teuthology.orchestra.run.smithi172.stdout:Need to get 190 MB of archives. 2024-06-11T17:15:30.193 INFO:teuthology.orchestra.run.smithi172.stdout:After this operation, 864 MB of additional disk space will be used. 2024-06-11T17:15:30.193 INFO:teuthology.orchestra.run.smithi172.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-06-11T17:15:30.193 INFO:teuthology.orchestra.run.smithi130.stdout:0 upgraded, 118 newly installed, 0 to remove and 311 not upgraded. 2024-06-11T17:15:30.193 INFO:teuthology.orchestra.run.smithi130.stdout:Need to get 190 MB of archives. 2024-06-11T17:15:30.194 INFO:teuthology.orchestra.run.smithi130.stdout:After this operation, 864 MB of additional disk space will be used. 2024-06-11T17:15:30.194 INFO:teuthology.orchestra.run.smithi130.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-06-11T17:15:30.329 INFO:teuthology.orchestra.run.smithi130.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-06-11T17:15:30.329 INFO:teuthology.orchestra.run.smithi172.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-06-11T17:15:30.332 INFO:teuthology.orchestra.run.smithi130.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-06-11T17:15:30.332 INFO:teuthology.orchestra.run.smithi172.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-06-11T17:15:30.352 INFO:teuthology.orchestra.run.smithi130.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-4216-g37bbe1d8-1jammy [3,565 kB] 2024-06-11T17:15:30.360 INFO:teuthology.orchestra.run.smithi130.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-06-11T17:15:30.360 INFO:teuthology.orchestra.run.smithi172.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-06-11T17:15:30.469 INFO:teuthology.orchestra.run.smithi130.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-06-11T17:15:30.470 INFO:teuthology.orchestra.run.smithi172.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-06-11T17:15:30.474 INFO:teuthology.orchestra.run.smithi130.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-06-11T17:15:30.481 INFO:teuthology.orchestra.run.smithi172.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-06-11T17:15:30.481 INFO:teuthology.orchestra.run.smithi172.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-4216-g37bbe1d8-1jammy [3,565 kB] 2024-06-11T17:15:30.493 INFO:teuthology.orchestra.run.smithi130.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-06-11T17:15:30.548 INFO:teuthology.orchestra.run.smithi130.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-06-11T17:15:30.549 INFO:teuthology.orchestra.run.smithi130.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-06-11T17:15:30.550 INFO:teuthology.orchestra.run.smithi130.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-06-11T17:15:30.603 INFO:teuthology.orchestra.run.smithi172.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-06-11T17:15:30.609 INFO:teuthology.orchestra.run.smithi172.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-06-11T17:15:30.610 INFO:teuthology.orchestra.run.smithi172.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-06-11T17:15:30.612 INFO:teuthology.orchestra.run.smithi172.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-06-11T17:15:30.623 INFO:teuthology.orchestra.run.smithi130.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-06-11T17:15:30.626 INFO:teuthology.orchestra.run.smithi172.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-06-11T17:15:30.627 INFO:teuthology.orchestra.run.smithi130.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-06-11T17:15:30.630 INFO:teuthology.orchestra.run.smithi172.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-06-11T17:15:30.633 INFO:teuthology.orchestra.run.smithi130.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-06-11T17:15:30.634 INFO:teuthology.orchestra.run.smithi130.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-06-11T17:15:30.634 INFO:teuthology.orchestra.run.smithi130.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-06-11T17:15:30.635 INFO:teuthology.orchestra.run.smithi172.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-06-11T17:15:30.637 INFO:teuthology.orchestra.run.smithi172.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-06-11T17:15:30.637 INFO:teuthology.orchestra.run.smithi172.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-06-11T17:15:30.639 INFO:teuthology.orchestra.run.smithi130.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-06-11T17:15:30.642 INFO:teuthology.orchestra.run.smithi172.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-06-11T17:15:30.643 INFO:teuthology.orchestra.run.smithi130.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-06-11T17:15:30.647 INFO:teuthology.orchestra.run.smithi130.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-06-11T17:15:30.648 INFO:teuthology.orchestra.run.smithi130.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-06-11T17:15:30.663 INFO:teuthology.orchestra.run.smithi130.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-06-11T17:15:30.670 INFO:teuthology.orchestra.run.smithi172.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-06-11T17:15:30.673 INFO:teuthology.orchestra.run.smithi172.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-06-11T17:15:30.674 INFO:teuthology.orchestra.run.smithi172.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-06-11T17:15:30.675 INFO:teuthology.orchestra.run.smithi172.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-06-11T17:15:30.675 INFO:teuthology.orchestra.run.smithi130.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-06-11T17:15:30.676 INFO:teuthology.orchestra.run.smithi130.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-06-11T17:15:30.677 INFO:teuthology.orchestra.run.smithi130.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-06-11T17:15:30.677 INFO:teuthology.orchestra.run.smithi172.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-06-11T17:15:30.677 INFO:teuthology.orchestra.run.smithi172.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-06-11T17:15:30.678 INFO:teuthology.orchestra.run.smithi130.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-06-11T17:15:30.678 INFO:teuthology.orchestra.run.smithi172.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-06-11T17:15:30.678 INFO:teuthology.orchestra.run.smithi172.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-06-11T17:15:30.679 INFO:teuthology.orchestra.run.smithi130.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-06-11T17:15:30.679 INFO:teuthology.orchestra.run.smithi130.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-06-11T17:15:30.680 INFO:teuthology.orchestra.run.smithi130.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-06-11T17:15:30.685 INFO:teuthology.orchestra.run.smithi130.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-06-11T17:15:30.686 INFO:teuthology.orchestra.run.smithi130.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-06-11T17:15:30.691 INFO:teuthology.orchestra.run.smithi172.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-06-11T17:15:30.691 INFO:teuthology.orchestra.run.smithi172.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-06-11T17:15:30.705 INFO:teuthology.orchestra.run.smithi130.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-06-11T17:15:30.705 INFO:teuthology.orchestra.run.smithi130.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-06-11T17:15:30.707 INFO:teuthology.orchestra.run.smithi130.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-06-11T17:15:30.708 INFO:teuthology.orchestra.run.smithi130.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-06-11T17:15:30.708 INFO:teuthology.orchestra.run.smithi130.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-06-11T17:15:30.711 INFO:teuthology.orchestra.run.smithi130.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-06-11T17:15:30.714 INFO:teuthology.orchestra.run.smithi172.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-06-11T17:15:30.718 INFO:teuthology.orchestra.run.smithi172.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-06-11T17:15:30.720 INFO:teuthology.orchestra.run.smithi172.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-06-11T17:15:30.721 INFO:teuthology.orchestra.run.smithi172.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-06-11T17:15:30.722 INFO:teuthology.orchestra.run.smithi172.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-06-11T17:15:30.724 INFO:teuthology.orchestra.run.smithi172.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-06-11T17:15:30.725 INFO:teuthology.orchestra.run.smithi172.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-06-11T17:15:30.725 INFO:teuthology.orchestra.run.smithi172.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-06-11T17:15:30.726 INFO:teuthology.orchestra.run.smithi130.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-06-11T17:15:30.727 INFO:teuthology.orchestra.run.smithi130.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-06-11T17:15:30.738 INFO:teuthology.orchestra.run.smithi130.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-06-11T17:15:30.738 INFO:teuthology.orchestra.run.smithi130.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-06-11T17:15:30.742 INFO:teuthology.orchestra.run.smithi172.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-06-11T17:15:30.743 INFO:teuthology.orchestra.run.smithi172.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-06-11T17:15:30.763 INFO:teuthology.orchestra.run.smithi130.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-06-11T17:15:30.765 INFO:teuthology.orchestra.run.smithi130.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-06-11T17:15:30.767 INFO:teuthology.orchestra.run.smithi130.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-06-11T17:15:30.771 INFO:teuthology.orchestra.run.smithi130.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-06-11T17:15:30.772 INFO:teuthology.orchestra.run.smithi130.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-06-11T17:15:30.774 INFO:teuthology.orchestra.run.smithi172.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-06-11T17:15:30.775 INFO:teuthology.orchestra.run.smithi130.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-06-11T17:15:30.786 INFO:teuthology.orchestra.run.smithi172.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-06-11T17:15:30.786 INFO:teuthology.orchestra.run.smithi172.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-06-11T17:15:30.788 INFO:teuthology.orchestra.run.smithi172.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-06-11T17:15:30.789 INFO:teuthology.orchestra.run.smithi172.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-06-11T17:15:30.792 INFO:teuthology.orchestra.run.smithi172.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-06-11T17:15:30.796 INFO:teuthology.orchestra.run.smithi172.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-06-11T17:15:30.797 INFO:teuthology.orchestra.run.smithi172.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-06-11T17:15:30.804 INFO:teuthology.orchestra.run.smithi130.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-06-11T17:15:30.810 INFO:teuthology.orchestra.run.smithi130.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-06-11T17:15:30.811 INFO:teuthology.orchestra.run.smithi130.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-06-11T17:15:30.813 INFO:teuthology.orchestra.run.smithi130.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-06-11T17:15:30.817 INFO:teuthology.orchestra.run.smithi172.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-06-11T17:15:30.819 INFO:teuthology.orchestra.run.smithi172.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-06-11T17:15:30.846 INFO:teuthology.orchestra.run.smithi130.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-06-11T17:15:30.862 INFO:teuthology.orchestra.run.smithi172.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-06-11T17:15:30.863 INFO:teuthology.orchestra.run.smithi172.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-06-11T17:15:30.865 INFO:teuthology.orchestra.run.smithi172.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-06-11T17:15:30.870 INFO:teuthology.orchestra.run.smithi172.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-06-11T17:15:31.047 INFO:teuthology.orchestra.run.smithi130.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-06-11T17:15:31.049 INFO:teuthology.orchestra.run.smithi130.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-06-11T17:15:31.051 INFO:teuthology.orchestra.run.smithi130.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-06-11T17:15:31.052 INFO:teuthology.orchestra.run.smithi130.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-06-11T17:15:31.054 INFO:teuthology.orchestra.run.smithi130.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-06-11T17:15:31.094 INFO:teuthology.orchestra.run.smithi130.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-06-11T17:15:31.098 INFO:teuthology.orchestra.run.smithi130.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-06-11T17:15:31.099 INFO:teuthology.orchestra.run.smithi130.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-06-11T17:15:31.102 INFO:teuthology.orchestra.run.smithi172.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-06-11T17:15:31.104 INFO:teuthology.orchestra.run.smithi172.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-06-11T17:15:31.109 INFO:teuthology.orchestra.run.smithi172.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-06-11T17:15:31.109 INFO:teuthology.orchestra.run.smithi172.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-06-11T17:15:31.112 INFO:teuthology.orchestra.run.smithi172.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-06-11T17:15:31.166 INFO:teuthology.orchestra.run.smithi130.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-06-11T17:15:31.166 INFO:teuthology.orchestra.run.smithi130.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-06-11T17:15:31.169 INFO:teuthology.orchestra.run.smithi130.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-06-11T17:15:31.170 INFO:teuthology.orchestra.run.smithi130.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-06-11T17:15:31.172 INFO:teuthology.orchestra.run.smithi130.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-06-11T17:15:31.174 INFO:teuthology.orchestra.run.smithi130.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-06-11T17:15:31.189 INFO:teuthology.orchestra.run.smithi130.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-06-11T17:15:31.190 INFO:teuthology.orchestra.run.smithi130.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-06-11T17:15:31.190 INFO:teuthology.orchestra.run.smithi172.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-06-11T17:15:31.196 INFO:teuthology.orchestra.run.smithi172.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-06-11T17:15:31.198 INFO:teuthology.orchestra.run.smithi172.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-06-11T17:15:31.214 INFO:teuthology.orchestra.run.smithi130.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-06-11T17:15:31.231 INFO:teuthology.orchestra.run.smithi130.stdout:Get:69 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-4216-g37bbe1d8-1jammy [3,229 kB] 2024-06-11T17:15:31.294 INFO:teuthology.orchestra.run.smithi130.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-06-11T17:15:31.298 INFO:teuthology.orchestra.run.smithi130.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-06-11T17:15:31.299 INFO:teuthology.orchestra.run.smithi130.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-06-11T17:15:31.306 INFO:teuthology.orchestra.run.smithi172.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-06-11T17:15:31.306 INFO:teuthology.orchestra.run.smithi172.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-06-11T17:15:31.307 INFO:teuthology.orchestra.run.smithi130.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-06-11T17:15:31.308 INFO:teuthology.orchestra.run.smithi172.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-06-11T17:15:31.309 INFO:teuthology.orchestra.run.smithi172.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-06-11T17:15:31.310 INFO:teuthology.orchestra.run.smithi172.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-06-11T17:15:31.311 INFO:teuthology.orchestra.run.smithi172.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-06-11T17:15:31.311 INFO:teuthology.orchestra.run.smithi172.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-06-11T17:15:31.312 INFO:teuthology.orchestra.run.smithi172.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-06-11T17:15:31.314 INFO:teuthology.orchestra.run.smithi130.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-06-11T17:15:31.316 INFO:teuthology.orchestra.run.smithi130.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-06-11T17:15:31.317 INFO:teuthology.orchestra.run.smithi130.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-06-11T17:15:31.319 INFO:teuthology.orchestra.run.smithi172.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-06-11T17:15:31.330 INFO:teuthology.orchestra.run.smithi130.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-06-11T17:15:31.331 INFO:teuthology.orchestra.run.smithi130.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-06-11T17:15:31.339 INFO:teuthology.orchestra.run.smithi130.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-06-11T17:15:31.340 INFO:teuthology.orchestra.run.smithi172.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-06-11T17:15:31.350 INFO:teuthology.orchestra.run.smithi172.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-06-11T17:15:31.352 INFO:teuthology.orchestra.run.smithi172.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-06-11T17:15:31.362 INFO:teuthology.orchestra.run.smithi172.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-06-11T17:15:31.365 INFO:teuthology.orchestra.run.smithi130.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-06-11T17:15:31.367 INFO:teuthology.orchestra.run.smithi130.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-06-11T17:15:31.368 INFO:teuthology.orchestra.run.smithi130.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-06-11T17:15:31.368 INFO:teuthology.orchestra.run.smithi172.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-06-11T17:15:31.371 INFO:teuthology.orchestra.run.smithi172.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-06-11T17:15:31.372 INFO:teuthology.orchestra.run.smithi130.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-06-11T17:15:31.372 INFO:teuthology.orchestra.run.smithi172.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-06-11T17:15:31.374 INFO:teuthology.orchestra.run.smithi130.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-06-11T17:15:31.391 INFO:teuthology.orchestra.run.smithi172.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-06-11T17:15:31.393 INFO:teuthology.orchestra.run.smithi172.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-06-11T17:15:31.397 INFO:teuthology.orchestra.run.smithi130.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-06-11T17:15:31.398 INFO:teuthology.orchestra.run.smithi130.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-06-11T17:15:31.398 INFO:teuthology.orchestra.run.smithi130.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-06-11T17:15:31.406 INFO:teuthology.orchestra.run.smithi130.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-06-11T17:15:31.407 INFO:teuthology.orchestra.run.smithi130.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-06-11T17:15:31.408 INFO:teuthology.orchestra.run.smithi172.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-06-11T17:15:31.408 INFO:teuthology.orchestra.run.smithi172.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-06-11T17:15:31.410 INFO:teuthology.orchestra.run.smithi172.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-06-11T17:15:31.410 INFO:teuthology.orchestra.run.smithi172.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-06-11T17:15:31.415 INFO:teuthology.orchestra.run.smithi172.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-06-11T17:15:31.417 INFO:teuthology.orchestra.run.smithi172.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-06-11T17:15:31.457 INFO:teuthology.orchestra.run.smithi172.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-06-11T17:15:31.458 INFO:teuthology.orchestra.run.smithi172.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-06-11T17:15:31.459 INFO:teuthology.orchestra.run.smithi172.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-06-11T17:15:31.496 INFO:teuthology.orchestra.run.smithi172.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-06-11T17:15:31.498 INFO:teuthology.orchestra.run.smithi172.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-06-11T17:15:31.652 INFO:teuthology.orchestra.run.smithi130.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-4216-g37bbe1d8-1jammy [716 kB] 2024-06-11T17:15:31.755 INFO:teuthology.orchestra.run.smithi130.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-4216-g37bbe1d8-1jammy [357 kB] 2024-06-11T17:15:31.771 INFO:teuthology.orchestra.run.smithi130.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-4216-g37bbe1d8-1jammy [32.8 kB] 2024-06-11T17:15:31.772 INFO:teuthology.orchestra.run.smithi130.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-4216-g37bbe1d8-1jammy [180 kB] 2024-06-11T17:15:31.818 INFO:teuthology.orchestra.run.smithi130.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-4216-g37bbe1d8-1jammy [67.4 kB] 2024-06-11T17:15:31.821 INFO:teuthology.orchestra.run.smithi130.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-4216-g37bbe1d8-1jammy [334 kB] 2024-06-11T17:15:31.852 INFO:teuthology.orchestra.run.smithi130.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-4216-g37bbe1d8-1jammy [7,899 kB] 2024-06-11T17:15:32.474 INFO:teuthology.orchestra.run.smithi172.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-4216-g37bbe1d8-1jammy [3,229 kB] 2024-06-11T17:15:32.562 INFO:teuthology.orchestra.run.smithi130.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-4216-g37bbe1d8-1jammy [112 kB] 2024-06-11T17:15:32.565 INFO:teuthology.orchestra.run.smithi130.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-4216-g37bbe1d8-1jammy [470 kB] 2024-06-11T17:15:32.655 INFO:teuthology.orchestra.run.smithi130.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-4216-g37bbe1d8-1jammy [27.9 MB] 2024-06-11T17:15:33.243 INFO:teuthology.orchestra.run.smithi172.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-4216-g37bbe1d8-1jammy [716 kB] 2024-06-11T17:15:33.363 INFO:teuthology.orchestra.run.smithi172.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-4216-g37bbe1d8-1jammy [357 kB] 2024-06-11T17:15:33.419 INFO:teuthology.orchestra.run.smithi172.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-4216-g37bbe1d8-1jammy [32.8 kB] 2024-06-11T17:15:33.420 INFO:teuthology.orchestra.run.smithi172.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-4216-g37bbe1d8-1jammy [180 kB] 2024-06-11T17:15:33.433 INFO:teuthology.orchestra.run.smithi172.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-4216-g37bbe1d8-1jammy [67.4 kB] 2024-06-11T17:15:33.439 INFO:teuthology.orchestra.run.smithi172.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-4216-g37bbe1d8-1jammy [334 kB] 2024-06-11T17:15:33.489 INFO:teuthology.orchestra.run.smithi172.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-4216-g37bbe1d8-1jammy [7,899 kB] 2024-06-11T17:15:34.308 INFO:teuthology.orchestra.run.smithi172.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-4216-g37bbe1d8-1jammy [112 kB] 2024-06-11T17:15:34.311 INFO:teuthology.orchestra.run.smithi172.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-4216-g37bbe1d8-1jammy [470 kB] 2024-06-11T17:15:34.358 INFO:teuthology.orchestra.run.smithi172.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-4216-g37bbe1d8-1jammy [27.9 MB] 2024-06-11T17:15:34.693 INFO:teuthology.orchestra.run.smithi130.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-4216-g37bbe1d8-1jammy [5,095 kB] 2024-06-11T17:15:34.951 INFO:teuthology.orchestra.run.smithi130.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-4216-g37bbe1d8-1jammy [247 kB] 2024-06-11T17:15:34.965 INFO:teuthology.orchestra.run.smithi130.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-4216-g37bbe1d8-1jammy [124 kB] 2024-06-11T17:15:34.976 INFO:teuthology.orchestra.run.smithi130.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-4216-g37bbe1d8-1jammy [1,546 kB] 2024-06-11T17:15:35.093 INFO:teuthology.orchestra.run.smithi130.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-4216-g37bbe1d8-1jammy [6,265 kB] 2024-06-11T17:15:35.660 INFO:teuthology.orchestra.run.smithi130.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-4216-g37bbe1d8-1jammy [22.8 MB] 2024-06-11T17:15:36.381 INFO:teuthology.orchestra.run.smithi172.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-4216-g37bbe1d8-1jammy [5,095 kB] 2024-06-11T17:15:36.580 INFO:teuthology.orchestra.run.smithi172.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-4216-g37bbe1d8-1jammy [247 kB] 2024-06-11T17:15:36.606 INFO:teuthology.orchestra.run.smithi172.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-4216-g37bbe1d8-1jammy [124 kB] 2024-06-11T17:15:36.611 INFO:teuthology.orchestra.run.smithi172.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-4216-g37bbe1d8-1jammy [1,546 kB] 2024-06-11T17:15:36.708 INFO:teuthology.orchestra.run.smithi172.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-4216-g37bbe1d8-1jammy [6,265 kB] 2024-06-11T17:15:37.108 INFO:teuthology.orchestra.run.smithi172.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-4216-g37bbe1d8-1jammy [22.8 MB] 2024-06-11T17:15:38.038 INFO:teuthology.orchestra.run.smithi130.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-4216-g37bbe1d8-1jammy [14.0 kB] 2024-06-11T17:15:38.038 INFO:teuthology.orchestra.run.smithi130.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-4216-g37bbe1d8-1jammy [871 kB] 2024-06-11T17:15:38.056 INFO:teuthology.orchestra.run.smithi130.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-4216-g37bbe1d8-1jammy [2,444 kB] 2024-06-11T17:15:38.211 INFO:teuthology.orchestra.run.smithi130.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-4216-g37bbe1d8-1jammy [792 kB] 2024-06-11T17:15:38.290 INFO:teuthology.orchestra.run.smithi130.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-4216-g37bbe1d8-1jammy [149 kB] 2024-06-11T17:15:38.309 INFO:teuthology.orchestra.run.smithi130.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-4216-g37bbe1d8-1jammy [2,297 kB] 2024-06-11T17:15:38.542 INFO:teuthology.orchestra.run.smithi130.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-4216-g37bbe1d8-1jammy [8,625 kB] 2024-06-11T17:15:38.721 INFO:teuthology.orchestra.run.smithi172.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-4216-g37bbe1d8-1jammy [14.0 kB] 2024-06-11T17:15:38.722 INFO:teuthology.orchestra.run.smithi172.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-4216-g37bbe1d8-1jammy [871 kB] 2024-06-11T17:15:38.739 INFO:teuthology.orchestra.run.smithi172.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-4216-g37bbe1d8-1jammy [2,444 kB] 2024-06-11T17:15:38.781 INFO:teuthology.orchestra.run.smithi172.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-4216-g37bbe1d8-1jammy [792 kB] 2024-06-11T17:15:38.800 INFO:teuthology.orchestra.run.smithi172.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-4216-g37bbe1d8-1jammy [149 kB] 2024-06-11T17:15:38.807 INFO:teuthology.orchestra.run.smithi172.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-4216-g37bbe1d8-1jammy [2,297 kB] 2024-06-11T17:15:38.986 INFO:teuthology.orchestra.run.smithi172.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-4216-g37bbe1d8-1jammy [8,625 kB] 2024-06-11T17:15:39.404 INFO:teuthology.orchestra.run.smithi130.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-4216-g37bbe1d8-1jammy [14.2 kB] 2024-06-11T17:15:39.404 INFO:teuthology.orchestra.run.smithi130.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-4216-g37bbe1d8-1jammy [54.8 MB] 2024-06-11T17:15:39.530 INFO:teuthology.orchestra.run.smithi172.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-4216-g37bbe1d8-1jammy [14.2 kB] 2024-06-11T17:15:39.531 INFO:teuthology.orchestra.run.smithi172.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-4216-g37bbe1d8-1jammy [54.8 MB] 2024-06-11T17:15:43.525 INFO:teuthology.orchestra.run.smithi172.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-4216-g37bbe1d8-1jammy [124 kB] 2024-06-11T17:15:43.527 INFO:teuthology.orchestra.run.smithi172.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-4216-g37bbe1d8-1jammy [38.9 kB] 2024-06-11T17:15:43.528 INFO:teuthology.orchestra.run.smithi172.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-4216-g37bbe1d8-1jammy [15.7 MB] 2024-06-11T17:15:44.403 INFO:teuthology.orchestra.run.smithi172.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-4216-g37bbe1d8-1jammy [91.3 kB] 2024-06-11T17:15:44.740 INFO:teuthology.orchestra.run.smithi130.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-4216-g37bbe1d8-1jammy [124 kB] 2024-06-11T17:15:44.743 INFO:teuthology.orchestra.run.smithi130.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-4216-g37bbe1d8-1jammy [38.9 kB] 2024-06-11T17:15:44.744 INFO:teuthology.orchestra.run.smithi130.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-4216-g37bbe1d8-1jammy [15.7 MB] 2024-06-11T17:15:44.968 INFO:teuthology.orchestra.run.smithi172.stdout:Fetched 190 MB in 14s (13.3 MB/s) 2024-06-11T17:15:45.128 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-06-11T17:15:45.225 INFO:teuthology.orchestra.run.smithi172.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165982 files and directories currently installed.) 2024-06-11T17:15:45.230 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-06-11T17:15:45.326 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-06-11T17:15:45.470 INFO:teuthology.orchestra.run.smithi130.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-06-10-1925/37bbe1d8d788b7c9a71280e7d510c295a5853f0b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-4216-g37bbe1d8-1jammy [91.3 kB] 2024-06-11T17:15:45.638 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-06-11T17:15:45.665 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-06-11T17:15:45.705 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-06-11T17:15:45.974 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-06-11T17:15:45.990 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-06-11T17:15:46.033 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-06-11T17:15:46.046 INFO:teuthology.orchestra.run.smithi130.stdout:Fetched 190 MB in 15s (12.3 MB/s) 2024-06-11T17:15:46.208 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-06-11T17:15:46.308 INFO:teuthology.orchestra.run.smithi130.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165982 files and directories currently installed.) 2024-06-11T17:15:46.314 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-06-11T17:15:46.401 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-06-11T17:15:46.512 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-06-11T17:15:46.538 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-06-11T17:15:46.586 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-06-11T17:15:46.893 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-06-11T17:15:46.920 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-06-11T17:15:46.960 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-06-11T17:15:47.090 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-06-11T17:15:47.116 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-06-11T17:15:47.172 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-06-11T17:15:47.296 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-06-11T17:15:47.322 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-06-11T17:15:47.362 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-06-11T17:15:47.476 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-06-11T17:15:47.503 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-06-11T17:15:47.542 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-06-11T17:15:47.799 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-06-11T17:15:47.825 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-06-11T17:15:47.874 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-06-11T17:15:47.896 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-06-11T17:15:47.922 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-06-11T17:15:47.963 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-06-11T17:15:48.257 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package librados2. 2024-06-11T17:15:48.268 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-06-11T17:15:48.272 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../007-librados2_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:15:48.295 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-06-11T17:15:48.307 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking librados2 (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:15:48.335 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-06-11T17:15:48.668 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package librbd1. 2024-06-11T17:15:48.671 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-06-11T17:15:48.683 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../008-librbd1_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:15:48.698 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-06-11T17:15:48.735 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking librbd1 (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:15:48.737 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-06-11T17:15:49.099 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-06-11T17:15:49.125 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-06-11T17:15:49.165 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-06-11T17:15:49.171 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libcephfs2. 2024-06-11T17:15:49.198 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:15:49.254 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libcephfs2 (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:15:49.443 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package librados2. 2024-06-11T17:15:49.469 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../007-librados2_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:15:49.501 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking librados2 (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:15:49.540 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-rados. 2024-06-11T17:15:49.556 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../010-python3-rados_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:15:49.598 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-rados (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:15:49.901 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-06-11T17:15:49.927 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-4216-g37bbe1d8-1jammy_all.deb ... 2024-06-11T17:15:49.945 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package librbd1. 2024-06-11T17:15:49.972 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../008-librbd1_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:15:49.991 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-ceph-argparse (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:15:50.012 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking librbd1 (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:15:50.220 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-cephfs. 2024-06-11T17:15:50.235 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:15:50.270 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-cephfs (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:15:50.448 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libcephfs2. 2024-06-11T17:15:50.474 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:15:50.514 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libcephfs2 (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:15:50.556 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-ceph-common. 2024-06-11T17:15:50.583 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-4216-g37bbe1d8-1jammy_all.deb ... 2024-06-11T17:15:50.622 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-ceph-common (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:15:50.792 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-rados. 2024-06-11T17:15:50.807 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../010-python3-rados_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:15:50.850 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-rados (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:15:50.942 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-wcwidth. 2024-06-11T17:15:50.969 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-06-11T17:15:51.009 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-06-11T17:15:51.153 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-06-11T17:15:51.179 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-4216-g37bbe1d8-1jammy_all.deb ... 2024-06-11T17:15:51.211 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-ceph-argparse (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:15:51.322 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-prettytable. 2024-06-11T17:15:51.347 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-06-11T17:15:51.387 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-06-11T17:15:51.421 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-cephfs. 2024-06-11T17:15:51.437 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:15:51.472 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-cephfs (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:15:51.631 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-rbd. 2024-06-11T17:15:51.646 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:15:51.681 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-rbd (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:15:51.795 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-ceph-common. 2024-06-11T17:15:51.821 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-4216-g37bbe1d8-1jammy_all.deb ... 2024-06-11T17:15:51.866 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-ceph-common (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:15:51.992 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-06-11T17:15:52.019 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-06-11T17:15:52.150 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-06-11T17:15:52.335 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-wcwidth. 2024-06-11T17:15:52.362 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-06-11T17:15:52.402 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-06-11T17:15:52.437 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-06-11T17:15:52.463 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-06-11T17:15:52.503 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-06-11T17:15:52.721 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-prettytable. 2024-06-11T17:15:52.747 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-06-11T17:15:52.788 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-06-11T17:15:52.831 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-06-11T17:15:52.857 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-06-11T17:15:52.898 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-06-11T17:15:53.015 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-rbd. 2024-06-11T17:15:53.030 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:15:53.065 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-rbd (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:15:53.184 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package lua5.1. 2024-06-11T17:15:53.211 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-06-11T17:15:53.242 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-06-11T17:15:53.401 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-06-11T17:15:53.427 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-06-11T17:15:53.468 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-06-11T17:15:53.529 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package lua-any. 2024-06-11T17:15:53.544 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-06-11T17:15:53.587 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking lua-any (27ubuntu1) ... 2024-06-11T17:15:53.745 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-06-11T17:15:53.760 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-06-11T17:15:53.804 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-06-11T17:15:53.815 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package zip. 2024-06-11T17:15:53.830 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-06-11T17:15:53.873 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking zip (3.0-12build2) ... 2024-06-11T17:15:54.106 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-06-11T17:15:54.121 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-06-11T17:15:54.164 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-06-11T17:15:54.209 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package unzip. 2024-06-11T17:15:54.236 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-06-11T17:15:54.276 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-06-11T17:15:54.492 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package lua5.1. 2024-06-11T17:15:54.519 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-06-11T17:15:54.559 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-06-11T17:15:54.638 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package luarocks. 2024-06-11T17:15:54.664 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-06-11T17:15:54.705 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-06-11T17:15:54.820 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package lua-any. 2024-06-11T17:15:54.835 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-06-11T17:15:54.870 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking lua-any (27ubuntu1) ... 2024-06-11T17:15:55.079 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package librgw2. 2024-06-11T17:15:55.107 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../025-librgw2_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:15:55.114 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package zip. 2024-06-11T17:15:55.129 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-06-11T17:15:55.138 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking librgw2 (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:15:55.172 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking zip (3.0-12build2) ... 2024-06-11T17:15:55.492 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package unzip. 2024-06-11T17:15:55.518 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-06-11T17:15:55.558 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-06-11T17:15:55.798 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-rgw. 2024-06-11T17:15:55.813 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:15:55.850 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-rgw (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:15:55.937 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package luarocks. 2024-06-11T17:15:55.964 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-06-11T17:15:56.003 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-06-11T17:15:56.151 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package liboath0:amd64. 2024-06-11T17:15:56.178 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-06-11T17:15:56.217 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-06-11T17:15:56.327 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package librgw2. 2024-06-11T17:15:56.354 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../025-librgw2_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:15:56.394 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking librgw2 (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:15:56.531 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libradosstriper1. 2024-06-11T17:15:56.557 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:15:56.597 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libradosstriper1 (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:15:56.942 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-common. 2024-06-11T17:15:56.969 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../029-ceph-common_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:15:56.988 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-rgw. 2024-06-11T17:15:57.000 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-common (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:15:57.003 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:15:57.046 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-rgw (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:15:57.515 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package liboath0:amd64. 2024-06-11T17:15:57.542 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-06-11T17:15:57.582 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-06-11T17:15:57.877 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libradosstriper1. 2024-06-11T17:15:57.905 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:15:57.960 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libradosstriper1 (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:15:58.371 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-common. 2024-06-11T17:15:58.398 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../029-ceph-common_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:15:58.437 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-common (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:15:58.606 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-base. 2024-06-11T17:15:58.632 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../030-ceph-base_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:15:58.682 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-base (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:15:59.218 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-06-11T17:15:59.245 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-06-11T17:15:59.285 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-06-11T17:15:59.596 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-cheroot. 2024-06-11T17:15:59.623 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-06-11T17:15:59.663 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-06-11T17:15:59.951 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-base. 2024-06-11T17:15:59.957 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-06-11T17:15:59.977 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../030-ceph-base_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:15:59.984 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-06-11T17:16:00.016 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-06-11T17:16:00.026 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-base (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:00.294 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-jaraco.text. 2024-06-11T17:16:00.320 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-06-11T17:16:00.360 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-06-11T17:16:00.555 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-06-11T17:16:00.581 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-06-11T17:16:00.621 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-06-11T17:16:00.655 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-06-11T17:16:00.681 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-06-11T17:16:00.722 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-06-11T17:16:00.882 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-cheroot. 2024-06-11T17:16:00.908 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-06-11T17:16:00.948 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-06-11T17:16:01.024 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-tempora. 2024-06-11T17:16:01.051 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-06-11T17:16:01.091 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-06-11T17:16:01.268 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-06-11T17:16:01.295 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-06-11T17:16:01.335 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-06-11T17:16:01.637 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-jaraco.text. 2024-06-11T17:16:01.664 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-06-11T17:16:01.704 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-06-11T17:16:01.998 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-06-11T17:16:02.025 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-06-11T17:16:02.044 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-portend. 2024-06-11T17:16:02.064 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-06-11T17:16:02.071 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-06-11T17:16:02.111 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-06-11T17:16:02.343 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-tempora. 2024-06-11T17:16:02.369 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-06-11T17:16:02.409 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-06-11T17:16:02.414 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-06-11T17:16:02.441 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-06-11T17:16:02.480 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-06-11T17:16:02.703 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-portend. 2024-06-11T17:16:02.730 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-06-11T17:16:02.770 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-06-11T17:16:02.783 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-cherrypy3. 2024-06-11T17:16:02.810 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-06-11T17:16:02.850 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-06-11T17:16:03.072 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-06-11T17:16:03.099 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-06-11T17:16:03.139 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-06-11T17:16:03.145 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-natsort. 2024-06-11T17:16:03.172 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-06-11T17:16:03.214 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-06-11T17:16:03.740 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-logutils. 2024-06-11T17:16:03.767 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-06-11T17:16:03.806 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-06-11T17:16:04.061 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-cherrypy3. 2024-06-11T17:16:04.088 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-06-11T17:16:04.127 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-06-11T17:16:04.134 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-markupsafe. 2024-06-11T17:16:04.162 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-06-11T17:16:04.201 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-06-11T17:16:04.464 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-natsort. 2024-06-11T17:16:04.487 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-mako. 2024-06-11T17:16:04.490 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-06-11T17:16:04.514 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-06-11T17:16:04.531 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-06-11T17:16:04.562 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-06-11T17:16:04.792 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-logutils. 2024-06-11T17:16:04.807 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-06-11T17:16:04.842 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-06-11T17:16:04.848 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-simplegeneric. 2024-06-11T17:16:04.864 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-06-11T17:16:04.898 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-06-11T17:16:05.145 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-markupsafe. 2024-06-11T17:16:05.171 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-06-11T17:16:05.185 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-singledispatch. 2024-06-11T17:16:05.211 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-06-11T17:16:05.212 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-06-11T17:16:05.251 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-06-11T17:16:05.514 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-mako. 2024-06-11T17:16:05.541 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-06-11T17:16:05.546 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-webob. 2024-06-11T17:16:05.573 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-06-11T17:16:05.581 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-06-11T17:16:05.612 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-06-11T17:16:05.909 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-simplegeneric. 2024-06-11T17:16:05.935 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-06-11T17:16:05.965 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-waitress. 2024-06-11T17:16:05.975 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-06-11T17:16:05.992 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-06-11T17:16:06.035 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-06-11T17:16:06.237 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-singledispatch. 2024-06-11T17:16:06.260 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-06-11T17:16:06.295 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-06-11T17:16:06.327 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-tempita. 2024-06-11T17:16:06.353 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-06-11T17:16:06.393 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-06-11T17:16:06.598 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-webob. 2024-06-11T17:16:06.624 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-06-11T17:16:06.663 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-paste. 2024-06-11T17:16:06.664 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-06-11T17:16:06.690 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-06-11T17:16:06.729 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-06-11T17:16:07.034 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-waitress. 2024-06-11T17:16:07.060 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-06-11T17:16:07.066 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-06-11T17:16:07.090 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-06-11T17:16:07.104 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-06-11T17:16:07.124 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-06-11T17:16:07.369 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pastedeploy. 2024-06-11T17:16:07.395 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-06-11T17:16:07.435 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-06-11T17:16:07.629 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-tempita. 2024-06-11T17:16:07.655 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-06-11T17:16:07.695 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-06-11T17:16:07.747 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-webtest. 2024-06-11T17:16:07.774 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-06-11T17:16:07.813 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-06-11T17:16:07.956 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-paste. 2024-06-11T17:16:07.971 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-06-11T17:16:08.006 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-06-11T17:16:08.124 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pecan. 2024-06-11T17:16:08.151 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-06-11T17:16:08.191 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-06-11T17:16:08.318 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-06-11T17:16:08.333 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-06-11T17:16:08.376 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-06-11T17:16:08.546 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-certifi. 2024-06-11T17:16:08.573 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-06-11T17:16:08.612 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-06-11T17:16:08.646 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pastedeploy. 2024-06-11T17:16:08.672 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-06-11T17:16:08.704 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-06-11T17:16:09.007 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-webtest. 2024-06-11T17:16:09.032 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-idna. 2024-06-11T17:16:09.033 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-06-11T17:16:09.059 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-06-11T17:16:09.073 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-06-11T17:16:09.090 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-06-11T17:16:09.376 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-urllib3. 2024-06-11T17:16:09.384 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pecan. 2024-06-11T17:16:09.403 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-06-11T17:16:09.411 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-06-11T17:16:09.443 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-06-11T17:16:09.451 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-06-11T17:16:09.788 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-requests. 2024-06-11T17:16:09.814 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-certifi. 2024-06-11T17:16:09.815 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-06-11T17:16:09.841 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-06-11T17:16:09.854 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-06-11T17:16:09.880 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-06-11T17:16:10.166 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-werkzeug. 2024-06-11T17:16:10.192 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-idna. 2024-06-11T17:16:10.193 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-06-11T17:16:10.218 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-06-11T17:16:10.232 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-06-11T17:16:10.258 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-06-11T17:16:10.477 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-06-11T17:16:10.492 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-4216-g37bbe1d8-1jammy_all.deb ... 2024-06-11T17:16:10.527 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr-modules-core (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:10.536 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-urllib3. 2024-06-11T17:16:10.563 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-06-11T17:16:10.603 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-06-11T17:16:10.898 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-requests. 2024-06-11T17:16:10.907 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-06-11T17:16:10.924 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-06-11T17:16:10.933 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:16:10.964 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-06-11T17:16:10.973 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:11.268 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-bcrypt. 2024-06-11T17:16:11.284 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-werkzeug. 2024-06-11T17:16:11.294 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-06-11T17:16:11.310 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-06-11T17:16:11.326 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-06-11T17:16:11.350 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-06-11T17:16:11.596 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-openssl. 2024-06-11T17:16:11.622 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-06-11T17:16:11.628 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-06-11T17:16:11.655 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-4216-g37bbe1d8-1jammy_all.deb ... 2024-06-11T17:16:11.662 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-06-11T17:16:11.695 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr-modules-core (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:11.998 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr. 2024-06-11T17:16:12.025 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:16:12.058 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-06-11T17:16:12.065 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:12.085 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:16:12.116 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:12.428 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-bcrypt. 2024-06-11T17:16:12.451 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mon. 2024-06-11T17:16:12.454 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-06-11T17:16:12.478 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:16:12.494 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-06-11T17:16:12.535 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mon (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:12.755 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-openssl. 2024-06-11T17:16:12.771 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-06-11T17:16:12.922 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-06-11T17:16:13.080 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-osd. 2024-06-11T17:16:13.107 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:16:13.146 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-osd (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:13.225 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr. 2024-06-11T17:16:13.251 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:16:13.291 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:13.678 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mon. 2024-06-11T17:16:13.705 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:16:13.744 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mon (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:14.341 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph. 2024-06-11T17:16:14.348 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-osd. 2024-06-11T17:16:14.357 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../066-ceph_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:16:14.375 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:16:14.399 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:14.414 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-osd (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:14.719 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-fuse. 2024-06-11T17:16:14.746 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:16:14.785 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-fuse (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:15.156 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mds. 2024-06-11T17:16:15.183 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:16:15.222 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mds (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:15.442 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph. 2024-06-11T17:16:15.470 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../066-ceph_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:16:15.509 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:15.650 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package cephadm. 2024-06-11T17:16:15.677 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../069-cephadm_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:16:15.716 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking cephadm (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:15.837 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-fuse. 2024-06-11T17:16:15.863 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:16:15.903 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-fuse (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:16.011 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-asyncssh. 2024-06-11T17:16:16.038 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-06-11T17:16:16.077 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-06-11T17:16:16.273 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mds. 2024-06-11T17:16:16.300 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:16:16.340 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mds (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:16.380 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python-babel-localedata. 2024-06-11T17:16:16.396 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-06-11T17:16:16.438 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-06-11T17:16:16.692 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package cephadm. 2024-06-11T17:16:16.708 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../069-cephadm_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:16:16.742 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking cephadm (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:17.054 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-asyncssh. 2024-06-11T17:16:17.081 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-06-11T17:16:17.120 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-06-11T17:16:17.398 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python-babel-localedata. 2024-06-11T17:16:17.424 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-06-11T17:16:17.460 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-babel. 2024-06-11T17:16:17.464 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-06-11T17:16:17.487 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-06-11T17:16:17.527 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-06-11T17:16:17.838 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-jinja2. 2024-06-11T17:16:17.865 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-06-11T17:16:17.905 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-06-11T17:16:18.283 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-06-11T17:16:18.310 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-4216-g37bbe1d8-1jammy_all.deb ... 2024-06-11T17:16:18.349 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr-cephadm (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:18.469 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-babel. 2024-06-11T17:16:18.485 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-06-11T17:16:18.519 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-06-11T17:16:18.686 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-repoze.lru. 2024-06-11T17:16:18.713 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-06-11T17:16:18.752 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-06-11T17:16:18.797 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-jinja2. 2024-06-11T17:16:18.821 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-06-11T17:16:18.855 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-06-11T17:16:19.030 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-routes. 2024-06-11T17:16:19.058 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-06-11T17:16:19.089 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-06-11T17:16:19.158 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-06-11T17:16:19.185 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-4216-g37bbe1d8-1jammy_all.deb ... 2024-06-11T17:16:19.225 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr-cephadm (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:19.503 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-repoze.lru. 2024-06-11T17:16:19.519 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-06-11T17:16:19.559 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-06-11T17:16:19.561 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-06-11T17:16:19.586 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-4216-g37bbe1d8-1jammy_all.deb ... 2024-06-11T17:16:19.625 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr-dashboard (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:19.864 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-routes. 2024-06-11T17:16:19.891 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-06-11T17:16:19.930 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-06-11T17:16:20.242 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-06-11T17:16:20.258 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-4216-g37bbe1d8-1jammy_all.deb ... 2024-06-11T17:16:20.300 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr-dashboard (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:20.855 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-06-11T17:16:20.871 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-06-11T17:16:20.913 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-06-11T17:16:21.342 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-joblib. 2024-06-11T17:16:21.358 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-06-11T17:16:21.392 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-06-11T17:16:21.555 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-06-11T17:16:21.571 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-06-11T17:16:21.613 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-06-11T17:16:21.754 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-06-11T17:16:21.781 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-06-11T17:16:21.820 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-06-11T17:16:22.059 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-joblib. 2024-06-11T17:16:22.086 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-06-11T17:16:22.125 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-06-11T17:16:22.131 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-sklearn. 2024-06-11T17:16:22.159 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-06-11T17:16:22.198 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-06-11T17:16:22.479 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-06-11T17:16:22.506 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-06-11T17:16:22.553 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-06-11T17:16:22.917 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-sklearn. 2024-06-11T17:16:22.940 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-06-11T17:16:22.942 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-06-11T17:16:22.967 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-4216-g37bbe1d8-1jammy_all.deb ... 2024-06-11T17:16:22.972 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-06-11T17:16:23.092 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:23.889 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-06-11T17:16:23.917 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-4216-g37bbe1d8-1jammy_all.deb ... 2024-06-11T17:16:24.037 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-cachetools. 2024-06-11T17:16:24.041 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:24.064 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-06-11T17:16:24.103 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-06-11T17:16:24.407 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pyasn1. 2024-06-11T17:16:24.434 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-06-11T17:16:24.473 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-06-11T17:16:24.743 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-06-11T17:16:24.759 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-06-11T17:16:24.793 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-06-11T17:16:24.962 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-cachetools. 2024-06-11T17:16:24.989 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-06-11T17:16:25.036 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-06-11T17:16:25.121 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-rsa. 2024-06-11T17:16:25.148 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-06-11T17:16:25.196 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-rsa (4.8-1) ... 2024-06-11T17:16:25.272 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pyasn1. 2024-06-11T17:16:25.288 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-06-11T17:16:25.331 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-06-11T17:16:25.516 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-google-auth. 2024-06-11T17:16:25.545 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-06-11T17:16:25.583 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-06-11T17:16:25.634 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-06-11T17:16:25.661 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-06-11T17:16:25.700 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-06-11T17:16:25.894 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-06-11T17:16:25.921 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-06-11T17:16:25.961 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-06-11T17:16:26.020 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-rsa. 2024-06-11T17:16:26.047 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-06-11T17:16:26.087 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-rsa (4.8-1) ... 2024-06-11T17:16:26.239 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-websocket. 2024-06-11T17:16:26.266 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-06-11T17:16:26.306 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-06-11T17:16:26.399 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-google-auth. 2024-06-11T17:16:26.426 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-06-11T17:16:26.465 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-06-11T17:16:26.659 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-kubernetes. 2024-06-11T17:16:26.686 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-06-11T17:16:26.725 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-06-11T17:16:26.785 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-06-11T17:16:26.814 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-06-11T17:16:26.851 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-06-11T17:16:27.146 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-websocket. 2024-06-11T17:16:27.174 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-06-11T17:16:27.213 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-06-11T17:16:27.439 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-06-11T17:16:27.456 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-4216-g37bbe1d8-1jammy_all.deb ... 2024-06-11T17:16:27.491 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-kubernetes. 2024-06-11T17:16:27.497 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:27.518 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-06-11T17:16:27.549 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-06-11T17:16:27.792 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libonig5:amd64. 2024-06-11T17:16:27.808 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-06-11T17:16:27.842 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-06-11T17:16:28.103 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libjq1:amd64. 2024-06-11T17:16:28.130 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-06-11T17:16:28.161 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-06-11T17:16:28.205 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-06-11T17:16:28.229 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-4216-g37bbe1d8-1jammy_all.deb ... 2024-06-11T17:16:28.271 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:28.422 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package jq. 2024-06-11T17:16:28.438 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-06-11T17:16:28.480 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-06-11T17:16:28.557 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libonig5:amd64. 2024-06-11T17:16:28.585 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-06-11T17:16:28.615 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-06-11T17:16:28.733 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package socat. 2024-06-11T17:16:28.761 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-06-11T17:16:28.800 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-06-11T17:16:28.935 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libjq1:amd64. 2024-06-11T17:16:28.962 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-06-11T17:16:29.001 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-06-11T17:16:29.103 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package xmlstarlet. 2024-06-11T17:16:29.118 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-06-11T17:16:29.153 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-06-11T17:16:29.271 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package jq. 2024-06-11T17:16:29.299 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-06-11T17:16:29.338 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-06-11T17:16:29.591 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package socat. 2024-06-11T17:16:29.618 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-06-11T17:16:29.657 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-06-11T17:16:29.682 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-test. 2024-06-11T17:16:29.698 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../097-ceph-test_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:16:29.740 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-test (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:29.918 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package xmlstarlet. 2024-06-11T17:16:29.934 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-06-11T17:16:29.968 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-06-11T17:16:30.356 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-test. 2024-06-11T17:16:30.372 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../097-ceph-test_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:16:30.405 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-test (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:32.078 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-volume. 2024-06-11T17:16:32.094 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-4216-g37bbe1d8-1jammy_all.deb ... 2024-06-11T17:16:32.127 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-volume (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:32.423 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libcephfs-dev. 2024-06-11T17:16:32.439 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:16:32.473 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libcephfs-dev (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:32.668 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-volume. 2024-06-11T17:16:32.695 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-4216-g37bbe1d8-1jammy_all.deb ... 2024-06-11T17:16:32.726 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-volume (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:32.768 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package lua-socket:amd64. 2024-06-11T17:16:32.795 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-06-11T17:16:32.834 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-06-11T17:16:33.013 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libcephfs-dev. 2024-06-11T17:16:33.029 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:16:33.072 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libcephfs-dev (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:33.247 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package lua-sec:amd64. 2024-06-11T17:16:33.275 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-06-11T17:16:33.313 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-06-11T17:16:33.399 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package lua-socket:amd64. 2024-06-11T17:16:33.427 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-06-11T17:16:33.466 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-06-11T17:16:33.693 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package nvme-cli. 2024-06-11T17:16:33.720 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-06-11T17:16:33.759 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-06-11T17:16:33.863 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package lua-sec:amd64. 2024-06-11T17:16:33.891 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-06-11T17:16:34.045 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-06-11T17:16:34.173 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package pkg-config. 2024-06-11T17:16:34.200 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-06-11T17:16:34.239 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-06-11T17:16:34.366 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package nvme-cli. 2024-06-11T17:16:34.393 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-06-11T17:16:34.432 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-06-11T17:16:34.492 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-06-11T17:16:34.520 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-06-11T17:16:34.559 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-06-11T17:16:34.846 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package pkg-config. 2024-06-11T17:16:34.874 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-06-11T17:16:34.912 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-06-11T17:16:35.004 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-iniconfig. 2024-06-11T17:16:35.031 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-06-11T17:16:35.078 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-06-11T17:16:35.182 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-06-11T17:16:35.210 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-06-11T17:16:35.249 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-06-11T17:16:35.348 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pastescript. 2024-06-11T17:16:35.375 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-06-11T17:16:35.406 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-06-11T17:16:35.660 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-iniconfig. 2024-06-11T17:16:35.688 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-06-11T17:16:35.710 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pluggy. 2024-06-11T17:16:35.726 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-06-11T17:16:35.737 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-06-11T17:16:35.776 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-06-11T17:16:36.038 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pastescript. 2024-06-11T17:16:36.065 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-06-11T17:16:36.087 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-psutil. 2024-06-11T17:16:36.104 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-06-11T17:16:36.115 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-06-11T17:16:36.154 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-06-11T17:16:36.399 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pluggy. 2024-06-11T17:16:36.427 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-06-11T17:16:36.457 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-06-11T17:16:36.484 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-py. 2024-06-11T17:16:36.511 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-06-11T17:16:36.550 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-py (1.10.0-1) ... 2024-06-11T17:16:36.743 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-psutil. 2024-06-11T17:16:36.771 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-06-11T17:16:36.810 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-06-11T17:16:36.870 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pygments. 2024-06-11T17:16:36.898 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-06-11T17:16:36.937 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-06-11T17:16:37.113 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-py. 2024-06-11T17:16:37.141 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-06-11T17:16:37.179 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-py (1.10.0-1) ... 2024-06-11T17:16:37.383 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pyinotify. 2024-06-11T17:16:37.410 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-06-11T17:16:37.449 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-06-11T17:16:37.491 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pygments. 2024-06-11T17:16:37.519 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-06-11T17:16:37.557 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-06-11T17:16:37.743 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-toml. 2024-06-11T17:16:37.771 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-06-11T17:16:37.857 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-06-11T17:16:38.028 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pyinotify. 2024-06-11T17:16:38.056 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-06-11T17:16:38.094 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-06-11T17:16:38.163 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pytest. 2024-06-11T17:16:38.190 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-06-11T17:16:38.229 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-06-11T17:16:38.389 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-toml. 2024-06-11T17:16:38.417 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-06-11T17:16:38.447 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-06-11T17:16:38.533 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-simplejson. 2024-06-11T17:16:38.561 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-06-11T17:16:38.591 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-06-11T17:16:38.725 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pytest. 2024-06-11T17:16:38.753 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-06-11T17:16:38.791 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-06-11T17:16:38.835 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-06-11T17:16:38.863 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-06-11T17:16:38.901 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-06-11T17:16:39.095 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-simplejson. 2024-06-11T17:16:39.123 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-06-11T17:16:39.178 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-06-11T17:16:39.431 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-06-11T17:16:39.447 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-06-11T17:16:39.481 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-06-11T17:16:39.631 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package radosgw. 2024-06-11T17:16:39.659 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../116-radosgw_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:16:39.697 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking radosgw (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:40.160 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package radosgw. 2024-06-11T17:16:40.188 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../116-radosgw_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:16:40.226 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking radosgw (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:40.642 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package rbd-fuse. 2024-06-11T17:16:40.658 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:16:40.700 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking rbd-fuse (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:40.971 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-06-11T17:16:41.154 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package rbd-fuse. 2024-06-11T17:16:41.170 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-4216-g37bbe1d8-1jammy_amd64.deb ... 2024-06-11T17:16:41.220 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking rbd-fuse (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:41.221 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-06-11T17:16:41.348 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-06-11T17:16:41.516 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-06-11T17:16:41.609 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-06-11T17:16:41.784 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-06-11T17:16:41.910 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-06-11T17:16:41.921 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-06-11T17:16:42.162 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-06-11T17:16:42.334 INFO:teuthology.orchestra.run.smithi172.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-06-11T17:16:42.400 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up cephadm (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:42.499 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-06-11T17:16:42.925 INFO:teuthology.orchestra.run.smithi172.stdout:Adding system user cephadm....done 2024-06-11T17:16:42.961 INFO:teuthology.orchestra.run.smithi130.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-06-11T17:16:43.028 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up cephadm (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:43.075 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-06-11T17:16:43.340 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-06-11T17:16:43.575 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-06-11T17:16:43.587 INFO:teuthology.orchestra.run.smithi130.stdout:Adding system user cephadm....done 2024-06-11T17:16:43.701 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-06-11T17:16:43.709 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-06-11T17:16:43.960 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-06-11T17:16:44.009 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-06-11T17:16:44.211 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-06-11T17:16:44.228 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-06-11T17:16:44.354 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-py (1.10.0-1) ... 2024-06-11T17:16:44.581 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-06-11T17:16:44.664 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-06-11T17:16:44.841 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-06-11T17:16:45.041 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-06-11T17:16:45.109 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-06-11T17:16:45.235 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-py (1.10.0-1) ... 2024-06-11T17:16:45.292 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-06-11T17:16:45.558 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-06-11T17:16:45.560 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-06-11T17:16:45.795 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-06-11T17:16:45.922 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-06-11T17:16:46.054 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-06-11T17:16:46.190 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-06-11T17:16:46.322 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-06-11T17:16:46.467 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-06-11T17:16:46.581 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-ceph-argparse (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:46.701 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-06-11T17:16:46.883 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-06-11T17:16:46.935 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-06-11T17:16:47.008 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-06-11T17:16:47.143 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-06-11T17:16:47.187 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-06-11T17:16:47.269 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-06-11T17:16:47.437 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-ceph-argparse (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:47.528 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-06-11T17:16:47.697 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-06-11T17:16:47.823 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-06-11T17:16:47.900 INFO:teuthology.orchestra.run.smithi172.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-06-11T17:16:47.934 INFO:teuthology.orchestra.run.smithi172.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-06-11T17:16:47.949 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-06-11T17:16:48.007 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-06-11T17:16:48.067 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-06-11T17:16:48.108 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-06-11T17:16:48.326 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-06-11T17:16:48.451 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-06-11T17:16:48.576 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-06-11T17:16:48.756 INFO:teuthology.orchestra.run.smithi130.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-06-11T17:16:48.782 INFO:teuthology.orchestra.run.smithi130.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-06-11T17:16:48.844 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-06-11T17:16:48.856 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-06-11T17:16:48.989 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-06-11T17:16:49.145 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-06-11T17:16:49.349 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-06-11T17:16:49.455 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up zip (3.0-12build2) ... 2024-06-11T17:16:49.491 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-06-11T17:16:49.581 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-06-11T17:16:49.759 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-06-11T17:16:50.018 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-06-11T17:16:50.250 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-06-11T17:16:50.328 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up zip (3.0-12build2) ... 2024-06-11T17:16:50.454 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-06-11T17:16:50.509 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-06-11T17:16:50.635 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-06-11T17:16:50.761 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-06-11T17:16:51.062 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-06-11T17:16:51.115 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-06-11T17:16:51.374 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-06-11T17:16:51.438 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-06-11T17:16:51.475 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-06-11T17:16:51.576 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-06-11T17:16:51.689 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-06-11T17:16:51.852 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-06-11T17:16:52.083 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-06-11T17:16:52.220 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-06-11T17:16:52.376 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-06-11T17:16:52.463 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-06-11T17:16:52.719 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-06-11T17:16:52.831 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-06-11T17:16:52.970 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-06-11T17:16:53.087 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-ceph-common (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:53.124 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-06-11T17:16:53.380 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-06-11T17:16:53.451 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-06-11T17:16:53.685 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-06-11T17:16:53.690 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-06-11T17:16:53.794 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-ceph-common (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:16:54.071 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-06-11T17:16:54.380 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-06-11T17:16:54.887 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-06-11T17:16:55.114 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-06-11T17:16:55.240 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-toml (0.10.2-1) ... 2024-06-11T17:16:55.491 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-06-11T17:16:55.545 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-06-11T17:16:55.600 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-06-11T17:16:55.726 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-06-11T17:16:55.788 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-06-11T17:16:55.922 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-toml (0.10.2-1) ... 2024-06-11T17:16:56.019 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-06-11T17:16:56.198 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-06-11T17:16:56.271 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-06-11T17:16:56.316 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-06-11T17:16:56.417 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-06-11T17:16:56.513 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-06-11T17:16:56.614 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-06-11T17:16:56.702 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-06-11T17:16:56.908 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-06-11T17:16:56.953 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-06-11T17:16:57.158 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-06-11T17:16:57.221 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-06-11T17:16:57.347 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-06-11T17:16:57.418 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-06-11T17:16:57.657 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-06-11T17:16:57.677 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-06-11T17:16:57.908 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-06-11T17:16:57.928 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-06-11T17:16:58.151 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-06-11T17:16:58.188 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-06-11T17:16:58.314 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-06-11T17:16:58.385 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-06-11T17:16:58.582 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-06-11T17:16:58.636 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-06-11T17:16:58.708 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-06-11T17:16:58.904 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-06-11T17:16:59.009 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-06-11T17:16:59.030 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-06-11T17:16:59.310 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-06-11T17:16:59.314 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-06-11T17:16:59.441 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-06-11T17:16:59.561 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-06-11T17:16:59.687 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-06-11T17:16:59.725 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-06-11T17:16:59.813 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-06-11T17:16:59.902 INFO:teuthology.orchestra.run.smithi172.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-06-11T17:17:00.034 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-06-11T17:17:00.140 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-06-11T17:17:00.266 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-06-11T17:17:00.277 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-06-11T17:17:00.395 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-06-11T17:17:00.521 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-06-11T17:17:00.610 INFO:teuthology.orchestra.run.smithi130.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-06-11T17:17:00.668 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-06-11T17:17:00.856 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-06-11T17:17:00.935 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up lua-any (27ubuntu1) ... 2024-06-11T17:17:00.999 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-06-11T17:17:01.061 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-portend (3.0.0-1) ... 2024-06-11T17:17:01.312 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-06-11T17:17:01.401 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-06-11T17:17:01.438 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-06-11T17:17:01.643 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up lua-any (27ubuntu1) ... 2024-06-11T17:17:01.753 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-portend (3.0.0-1) ... 2024-06-11T17:17:01.756 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-06-11T17:17:02.012 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-06-11T17:17:02.033 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-06-11T17:17:02.138 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-06-11T17:17:02.284 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-06-11T17:17:02.410 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-rsa (4.8-1) ... 2024-06-11T17:17:02.456 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-06-11T17:17:02.678 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-06-11T17:17:02.757 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-06-11T17:17:02.954 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-06-11T17:17:03.017 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-06-11T17:17:03.134 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-rsa (4.8-1) ... 2024-06-11T17:17:03.315 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-06-11T17:17:03.402 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-06-11T17:17:03.662 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-06-11T17:17:03.675 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-06-11T17:17:03.952 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-06-11T17:17:03.998 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-06-11T17:17:04.304 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-06-11T17:17:04.384 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-06-11T17:17:04.405 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up librados2 (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:04.523 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libsqlite3-mod-ceph (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:04.649 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-06-11T17:17:04.668 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-06-11T17:17:05.002 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libcephfs2 (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:05.046 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-06-11T17:17:05.128 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libradosstriper1 (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:05.172 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up librados2 (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:05.245 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-06-11T17:17:05.307 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libsqlite3-mod-ceph (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:05.424 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-06-11T17:17:05.522 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up librbd1 (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:05.631 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr-modules-core (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:05.711 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libcephfs2 (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:05.733 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-fuse (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:05.837 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libradosstriper1 (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:05.935 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-06-11T17:17:05.935 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-06-11T17:17:05.963 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-06-11T17:17:06.240 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up librbd1 (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:06.401 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libcephfs-dev (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:06.424 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr-modules-core (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:06.527 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-rados (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:06.550 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-fuse (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:06.653 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up librgw2 (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:06.754 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-06-11T17:17:06.754 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-06-11T17:17:06.779 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-06-11T17:17:07.251 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libcephfs-dev (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:07.378 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-rados (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:07.504 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up librgw2 (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:07.630 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-06-11T17:17:07.983 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-rbd (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:08.109 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up rbd-fuse (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:08.235 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-rgw (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:08.361 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-cephfs (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:08.487 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-common (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:08.767 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-rbd (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:08.868 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up rbd-fuse (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:08.986 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-rgw (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:09.004 INFO:teuthology.orchestra.run.smithi172.stdout:Adding group ceph....done 2024-06-11T17:17:09.112 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-cephfs (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:09.238 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-common (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:09.314 INFO:teuthology.orchestra.run.smithi172.stdout:Adding system user ceph....done 2024-06-11T17:17:09.450 INFO:teuthology.orchestra.run.smithi172.stdout:Setting system user ceph properties....done 2024-06-11T17:17:09.464 INFO:teuthology.orchestra.run.smithi172.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-06-11T17:17:09.602 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-06-11T17:17:09.797 INFO:teuthology.orchestra.run.smithi130.stdout:Adding group ceph....done 2024-06-11T17:17:09.947 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-06-11T17:17:10.182 INFO:teuthology.orchestra.run.smithi130.stdout:Adding system user ceph....done 2024-06-11T17:17:10.359 INFO:teuthology.orchestra.run.smithi130.stdout:Setting system user ceph properties....done 2024-06-11T17:17:10.376 INFO:teuthology.orchestra.run.smithi130.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-06-11T17:17:10.429 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-test (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:10.513 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-06-11T17:17:10.564 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up radosgw (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:10.845 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-06-11T17:17:11.024 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-06-11T17:17:11.024 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-06-11T17:17:11.533 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-base (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:11.582 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-test (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:11.708 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up radosgw (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:11.912 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-06-11T17:17:12.155 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-06-11T17:17:12.155 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-06-11T17:17:12.369 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mds (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:12.604 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-06-11T17:17:12.604 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-06-11T17:17:12.651 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-base (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:12.985 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-06-11T17:17:13.062 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:13.255 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-06-11T17:17:13.255 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-06-11T17:17:13.495 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mds (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:13.713 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-06-11T17:17:13.713 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-06-11T17:17:13.730 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-osd (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:14.010 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-06-11T17:17:14.010 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-06-11T17:17:14.214 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:14.429 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-06-11T17:17:14.429 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-06-11T17:17:14.482 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr-k8sevents (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:14.600 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:14.751 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mon (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:14.923 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-osd (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:14.962 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-06-11T17:17:14.962 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-06-11T17:17:15.193 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-06-11T17:17:15.193 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-06-11T17:17:15.410 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr-cephadm (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:15.561 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:15.687 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr-dashboard (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:15.734 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr-k8sevents (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:15.822 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-volume (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:15.834 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:15.986 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mon (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:16.167 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-06-11T17:17:16.208 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-06-11T17:17:16.209 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-06-11T17:17:16.293 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-06-11T17:17:16.445 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-06-11T17:17:16.687 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr-cephadm (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:16.847 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:16.990 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr-dashboard (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:17.141 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-volume (19.0.0-4216-g37bbe1d8-1jammy) ... 2024-06-11T17:17:17.486 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-06-11T17:17:17.554 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-06-11T17:17:17.638 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-06-11T17:17:17.859 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-06-11T17:17:18.196 INFO:teuthology.orchestra.run.smithi172.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-06-11T17:17:18.199 DEBUG:teuthology.orchestra.run.smithi172:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install sqlite3 2024-06-11T17:17:18.254 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2024-06-11T17:17:18.456 INFO:teuthology.orchestra.run.smithi172.stdout:Building dependency tree... 2024-06-11T17:17:18.457 INFO:teuthology.orchestra.run.smithi172.stdout:Reading state information... 2024-06-11T17:17:18.634 INFO:teuthology.orchestra.run.smithi172.stdout:The following packages were automatically installed and are no longer required: 2024-06-11T17:17:18.634 INFO:teuthology.orchestra.run.smithi172.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-06-11T17:17:18.634 INFO:teuthology.orchestra.run.smithi172.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-06-11T17:17:18.634 INFO:teuthology.orchestra.run.smithi172.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-06-11T17:17:18.634 INFO:teuthology.orchestra.run.smithi172.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-06-11T17:17:18.635 INFO:teuthology.orchestra.run.smithi172.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-06-11T17:17:18.635 INFO:teuthology.orchestra.run.smithi172.stdout:Use 'sudo apt autoremove' to remove them. 2024-06-11T17:17:18.636 INFO:teuthology.orchestra.run.smithi172.stdout:The following additional packages will be installed: 2024-06-11T17:17:18.636 INFO:teuthology.orchestra.run.smithi172.stdout: libsqlite3-0 2024-06-11T17:17:18.637 INFO:teuthology.orchestra.run.smithi172.stdout:Suggested packages: 2024-06-11T17:17:18.637 INFO:teuthology.orchestra.run.smithi172.stdout: sqlite3-doc 2024-06-11T17:17:18.667 INFO:teuthology.orchestra.run.smithi172.stdout:The following NEW packages will be installed: 2024-06-11T17:17:18.667 INFO:teuthology.orchestra.run.smithi172.stdout: sqlite3 2024-06-11T17:17:18.668 INFO:teuthology.orchestra.run.smithi172.stdout:The following packages will be upgraded: 2024-06-11T17:17:18.668 INFO:teuthology.orchestra.run.smithi172.stdout: libsqlite3-0 2024-06-11T17:17:19.006 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-06-11T17:17:19.413 INFO:teuthology.orchestra.run.smithi172.stdout:1 upgraded, 1 newly installed, 0 to remove and 310 not upgraded. 2024-06-11T17:17:19.414 INFO:teuthology.orchestra.run.smithi172.stdout:Need to get 1,410 kB of archives. 2024-06-11T17:17:19.414 INFO:teuthology.orchestra.run.smithi172.stdout:After this operation, 1,873 kB of additional disk space will be used. 2024-06-11T17:17:19.414 INFO:teuthology.orchestra.run.smithi172.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libsqlite3-0 amd64 3.37.2-2ubuntu0.3 [641 kB] 2024-06-11T17:17:19.562 INFO:teuthology.orchestra.run.smithi172.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 sqlite3 amd64 3.37.2-2ubuntu0.3 [768 kB] 2024-06-11T17:17:19.657 INFO:teuthology.orchestra.run.smithi130.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-06-11T17:17:19.659 DEBUG:teuthology.orchestra.run.smithi130:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install sqlite3 2024-06-11T17:17:19.765 INFO:teuthology.orchestra.run.smithi130.stdout:Reading package lists... 2024-06-11T17:17:19.953 INFO:teuthology.orchestra.run.smithi172.stdout:Fetched 1,410 kB in 1s (1,548 kB/s) 2024-06-11T17:17:19.967 INFO:teuthology.orchestra.run.smithi130.stdout:Building dependency tree... 2024-06-11T17:17:19.968 INFO:teuthology.orchestra.run.smithi130.stdout:Reading state information... 2024-06-11T17:17:20.153 INFO:teuthology.orchestra.run.smithi130.stdout:The following packages were automatically installed and are no longer required: 2024-06-11T17:17:20.154 INFO:teuthology.orchestra.run.smithi130.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-06-11T17:17:20.154 INFO:teuthology.orchestra.run.smithi130.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-06-11T17:17:20.154 INFO:teuthology.orchestra.run.smithi130.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-06-11T17:17:20.154 INFO:teuthology.orchestra.run.smithi130.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-06-11T17:17:20.155 INFO:teuthology.orchestra.run.smithi130.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-06-11T17:17:20.155 INFO:teuthology.orchestra.run.smithi130.stdout:Use 'sudo apt autoremove' to remove them. 2024-06-11T17:17:20.155 INFO:teuthology.orchestra.run.smithi130.stdout:The following additional packages will be installed: 2024-06-11T17:17:20.156 INFO:teuthology.orchestra.run.smithi130.stdout: libsqlite3-0 2024-06-11T17:17:20.157 INFO:teuthology.orchestra.run.smithi130.stdout:Suggested packages: 2024-06-11T17:17:20.157 INFO:teuthology.orchestra.run.smithi130.stdout: sqlite3-doc 2024-06-11T17:17:20.185 INFO:teuthology.orchestra.run.smithi130.stdout:The following NEW packages will be installed: 2024-06-11T17:17:20.185 INFO:teuthology.orchestra.run.smithi130.stdout: sqlite3 2024-06-11T17:17:20.186 INFO:teuthology.orchestra.run.smithi130.stdout:The following packages will be upgraded: 2024-06-11T17:17:20.187 INFO:teuthology.orchestra.run.smithi130.stdout: libsqlite3-0 2024-06-11T17:17:20.227 INFO:teuthology.orchestra.run.smithi172.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173901 files and directories currently installed.) 2024-06-11T17:17:20.233 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../libsqlite3-0_3.37.2-2ubuntu0.3_amd64.deb ... 2024-06-11T17:17:20.400 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libsqlite3-0:amd64 (3.37.2-2ubuntu0.3) over (3.37.2-2ubuntu0.1) ... 2024-06-11T17:17:20.728 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package sqlite3. 2024-06-11T17:17:20.753 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../sqlite3_3.37.2-2ubuntu0.3_amd64.deb ... 2024-06-11T17:17:20.795 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking sqlite3 (3.37.2-2ubuntu0.3) ... 2024-06-11T17:17:21.139 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libsqlite3-0:amd64 (3.37.2-2ubuntu0.3) ... 2024-06-11T17:17:21.241 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up sqlite3 (3.37.2-2ubuntu0.3) ... 2024-06-11T17:17:21.435 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-06-11T17:17:22.256 INFO:teuthology.orchestra.run.smithi130.stdout:1 upgraded, 1 newly installed, 0 to remove and 310 not upgraded. 2024-06-11T17:17:22.256 INFO:teuthology.orchestra.run.smithi130.stdout:Need to get 1,410 kB of archives. 2024-06-11T17:17:22.256 INFO:teuthology.orchestra.run.smithi130.stdout:After this operation, 1,873 kB of additional disk space will be used. 2024-06-11T17:17:22.257 INFO:teuthology.orchestra.run.smithi130.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libsqlite3-0 amd64 3.37.2-2ubuntu0.3 [641 kB] 2024-06-11T17:17:22.404 INFO:teuthology.orchestra.run.smithi130.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 sqlite3 amd64 3.37.2-2ubuntu0.3 [768 kB] 2024-06-11T17:17:22.494 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-06-11T17:17:22.791 INFO:teuthology.orchestra.run.smithi130.stdout:Fetched 1,410 kB in 2s (631 kB/s) 2024-06-11T17:17:22.966 INFO:teuthology.orchestra.run.smithi172.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-06-11T17:17:22.973 DEBUG:teuthology.parallel:result is None 2024-06-11T17:17:23.056 INFO:teuthology.orchestra.run.smithi130.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173901 files and directories currently installed.) 2024-06-11T17:17:23.062 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../libsqlite3-0_3.37.2-2ubuntu0.3_amd64.deb ... 2024-06-11T17:17:23.228 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libsqlite3-0:amd64 (3.37.2-2ubuntu0.3) over (3.37.2-2ubuntu0.1) ... 2024-06-11T17:17:23.566 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package sqlite3. 2024-06-11T17:17:23.593 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../sqlite3_3.37.2-2ubuntu0.3_amd64.deb ... 2024-06-11T17:17:23.632 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking sqlite3 (3.37.2-2ubuntu0.3) ... 2024-06-11T17:17:23.989 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libsqlite3-0:amd64 (3.37.2-2ubuntu0.3) ... 2024-06-11T17:17:24.111 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up sqlite3 (3.37.2-2ubuntu0.3) ... 2024-06-11T17:17:24.238 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-06-11T17:17:25.264 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-06-11T17:17:25.688 INFO:teuthology.orchestra.run.smithi130.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-06-11T17:17:25.693 DEBUG:teuthology.parallel:result is None 2024-06-11T17:17:25.693 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=37bbe1d8d788b7c9a71280e7d510c295a5853f0b 2024-06-11T17:17:25.916 DEBUG:teuthology.orchestra.run.smithi130:> dpkg-query -W -f '${Version}' ceph 2024-06-11T17:17:25.936 INFO:teuthology.orchestra.run.smithi130.stdout:19.0.0-4216-g37bbe1d8-1jammy 2024-06-11T17:17:25.936 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-4216-g37bbe1d8-1jammy 2024-06-11T17:17:25.936 INFO:teuthology.task.install:The correct ceph version 19.0.0-4216-g37bbe1d8-1jammy is installed. 2024-06-11T17:17:25.938 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=37bbe1d8d788b7c9a71280e7d510c295a5853f0b 2024-06-11T17:17:26.073 DEBUG:teuthology.orchestra.run.smithi172:> dpkg-query -W -f '${Version}' ceph 2024-06-11T17:17:26.092 INFO:teuthology.orchestra.run.smithi172.stdout:19.0.0-4216-g37bbe1d8-1jammy 2024-06-11T17:17:26.092 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-4216-g37bbe1d8-1jammy 2024-06-11T17:17:26.092 INFO:teuthology.task.install:The correct ceph version 19.0.0-4216-g37bbe1d8-1jammy is installed. 2024-06-11T17:17:26.093 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-06-11T17:17:26.094 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-06-11T17:17:26.094 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-11T17:17:26.108 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-06-11T17:17:26.108 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-11T17:17:26.148 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-06-11T17:17:26.148 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-06-11T17:17:26.148 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/daemon-helper 2024-06-11T17:17:26.164 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-11T17:17:26.218 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-06-11T17:17:26.218 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/daemon-helper 2024-06-11T17:17:26.232 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-11T17:17:26.291 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-06-11T17:17:26.292 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-06-11T17:17:26.292 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-11T17:17:26.304 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-11T17:17:26.358 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-06-11T17:17:26.358 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-11T17:17:26.370 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-11T17:17:26.423 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-06-11T17:17:26.423 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-06-11T17:17:26.423 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/stdin-killer 2024-06-11T17:17:26.437 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-11T17:17:26.490 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-06-11T17:17:26.490 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/stdin-killer 2024-06-11T17:17:26.504 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-11T17:17:26.559 INFO:teuthology.run_tasks:Running task ceph... 2024-06-11T17:17:26.636 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-06-11T17:17:26.636 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 777 /var/log/ceph 2024-06-11T17:17:26.638 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 777 /var/log/ceph 2024-06-11T17:17:26.651 INFO:tasks.ceph:Disabling ceph logrotate... 2024-06-11T17:17:26.651 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /etc/logrotate.d/ceph 2024-06-11T17:17:26.693 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/logrotate.d/ceph 2024-06-11T17:17:26.704 INFO:tasks.ceph:Creating extra log directories... 2024-06-11T17:17:26.704 DEBUG:teuthology.orchestra.run.smithi130:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-06-11T17:17:26.745 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-06-11T17:17:26.768 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-06-11T17:17:26.768 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(CEPHADM_STRAY_DAEMON\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-06-11T17:17:26.768 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/lflores-2024-06-10_22:21:08-rados-wip-lflores-testing-2-2024-06-10-1925-distro-default-smithi/7749723', 'branch': 'wip-lflores-testing-2-2024-06-10-1925', 'description': 'rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests}', 'email': None, 'first_in_suite': False, 'job_id': '7749723', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'lflores-2024-06-10_22:21:08-rados-wip-lflores-testing-2-2024-06-10-1925-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-lflores-testing-2-2024-06-10-1925'}, 'ceph': {'conf': {'client': {'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(CEPHADM_STRAY_DAEMON\\)'], 'sha1': '37bbe1d8d788b7c9a71280e7d510c295a5853f0b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '37bbe1d8d788b7c9a71280e7d510c295a5853f0b'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lflores-testing-2-2024-06-10-1925', 'sha1': '37bbe1d8d788b7c9a71280e7d510c295a5853f0b'}}, 'owner': 'scheduled_lflores@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 7590, 'sha1': '37bbe1d8d788b7c9a71280e7d510c295a5853f0b', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-lflores-testing-2-2024-06-10-1925', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_37bbe1d8d788b7c9a71280e7d510c295a5853f0b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '37bbe1d8d788b7c9a71280e7d510c295a5853f0b', 'targets': {'smithi130.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMEVIOKax7L8HABjAXmabrvjcIvOwt8ZoXV7eadY/Q2cirnplaKZCSY2F32IOvoWcKTf+fydBe1iYnwXax7nJUI=', 'smithi172.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHRxNdRdXRPyDWdHKr2RkGUHfnE1dAN4tWIlaZ+C0SBFPtjrAYNe758bWGqzrVgL4AXIHDMfpZ3/Z9nknYsJ2Mw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['sqlite3'], 'rpm': ['sqlite-devel']}, 'flavor': 'default', 'sha1': '37bbe1d8d788b7c9a71280e7d510c295a5853f0b'}}, {'ceph': None}, {'workunit': {'clients': {'client.0': ['rados/test.sh', 'rados/test_pool_quota.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '861a8dcf7aa816a26e13f039336f7ed0a9aec0fa', 'timestamp': '2024-06-10_22:21:08', 'tube': 'smithi', 'user': 'lflores', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841'} 2024-06-11T17:17:26.769 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-06-11T17:17:26.801 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-06-11T17:17:26.807 DEBUG:teuthology.orchestra.run.smithi130:> sudo install -d -m0777 -- /var/run/ceph 2024-06-11T17:17:26.849 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m0777 -- /var/run/ceph 2024-06-11T17:17:26.864 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-06-11T17:17:26.864 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/scratch_devs of=/dev/stdout 2024-06-11T17:17:26.908 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-11T17:17:26.908 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_1 2024-06-11T17:17:26.960 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-11T17:17:26.960 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-11T17:17:26.960 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 876 Links: 1 2024-06-11T17:17:26.960 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-11T17:17:26.960 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-06-11 17:12:01.899729733 +0000 2024-06-11T17:17:26.961 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-06-11 17:12:01.623732195 +0000 2024-06-11T17:17:26.961 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-06-11 17:12:01.623732195 +0000 2024-06-11T17:17:26.961 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: - 2024-06-11T17:17:26.961 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-11T17:17:27.014 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-06-11T17:17:27.014 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-06-11T17:17:27.014 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000449916 s, 1.1 MB/s 2024-06-11T17:17:27.015 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-11T17:17:27.065 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_2 2024-06-11T17:17:27.111 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-11T17:17:27.112 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-11T17:17:27.112 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 894 Links: 1 2024-06-11T17:17:27.112 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-11T17:17:27.112 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-06-11 17:12:02.439724916 +0000 2024-06-11T17:17:27.112 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-06-11 17:12:02.167727342 +0000 2024-06-11T17:17:27.112 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-06-11 17:12:02.167727342 +0000 2024-06-11T17:17:27.112 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: - 2024-06-11T17:17:27.112 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-11T17:17:27.166 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-06-11T17:17:27.166 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-06-11T17:17:27.166 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000345042 s, 1.5 MB/s 2024-06-11T17:17:27.167 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-11T17:17:27.218 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_3 2024-06-11T17:17:27.263 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-11T17:17:27.264 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-11T17:17:27.264 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 913 Links: 1 2024-06-11T17:17:27.264 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-11T17:17:27.264 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-06-11 17:12:02.683722739 +0000 2024-06-11T17:17:27.264 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-06-11 17:12:02.679722774 +0000 2024-06-11T17:17:27.264 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-06-11 17:12:02.679722774 +0000 2024-06-11T17:17:27.264 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: - 2024-06-11T17:17:27.264 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-11T17:17:27.322 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-06-11T17:17:27.323 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-06-11T17:17:27.323 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000390503 s, 1.3 MB/s 2024-06-11T17:17:27.324 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-11T17:17:27.373 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_4 2024-06-11T17:17:27.423 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-11T17:17:27.425 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-11T17:17:27.425 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 928 Links: 1 2024-06-11T17:17:27.425 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-11T17:17:27.426 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-06-11 17:12:03.467715745 +0000 2024-06-11T17:17:27.426 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-06-11 17:12:03.195718172 +0000 2024-06-11T17:17:27.426 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-06-11 17:12:03.195718172 +0000 2024-06-11T17:17:27.426 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: - 2024-06-11T17:17:27.426 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-11T17:17:27.478 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-06-11T17:17:27.478 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-06-11T17:17:27.478 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000370386 s, 1.4 MB/s 2024-06-11T17:17:27.479 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-11T17:17:27.529 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-11T17:17:27.529 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-06-11T17:17:27.529 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/scratch_devs of=/dev/stdout 2024-06-11T17:17:27.535 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-11T17:17:27.535 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_1 2024-06-11T17:17:27.584 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-11T17:17:27.584 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-11T17:17:27.584 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 876 Links: 1 2024-06-11T17:17:27.584 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-11T17:17:27.584 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-06-11 17:12:01.638675422 +0000 2024-06-11T17:17:27.584 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-06-11 17:12:01.362677884 +0000 2024-06-11T17:17:27.584 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-06-11 17:12:01.362677884 +0000 2024-06-11T17:17:27.585 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2024-06-11T17:17:27.585 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-11T17:17:27.638 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-06-11T17:17:27.638 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-06-11T17:17:27.639 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000453103 s, 1.1 MB/s 2024-06-11T17:17:27.640 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-11T17:17:27.689 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_2 2024-06-11T17:17:27.736 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-11T17:17:27.736 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-11T17:17:27.736 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 893 Links: 1 2024-06-11T17:17:27.736 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-11T17:17:27.736 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-06-11 17:12:01.854673494 +0000 2024-06-11T17:17:27.736 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-06-11 17:12:01.850673531 +0000 2024-06-11T17:17:27.736 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-06-11 17:12:01.850673531 +0000 2024-06-11T17:17:27.736 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2024-06-11T17:17:27.737 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-11T17:17:27.790 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-06-11T17:17:27.790 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-06-11T17:17:27.790 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000450562 s, 1.1 MB/s 2024-06-11T17:17:27.791 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-11T17:17:27.841 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_3 2024-06-11T17:17:27.888 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-11T17:17:27.888 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-11T17:17:27.888 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 911 Links: 1 2024-06-11T17:17:27.888 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-11T17:17:27.888 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-06-11 17:12:02.598666857 +0000 2024-06-11T17:17:27.888 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-06-11 17:12:02.342669142 +0000 2024-06-11T17:17:27.888 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-06-11 17:12:02.342669142 +0000 2024-06-11T17:17:27.888 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2024-06-11T17:17:27.889 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-11T17:17:27.942 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-06-11T17:17:27.943 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-06-11T17:17:27.943 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000383572 s, 1.3 MB/s 2024-06-11T17:17:27.944 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-11T17:17:27.993 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_4 2024-06-11T17:17:28.039 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-11T17:17:28.040 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-11T17:17:28.040 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-06-11T17:17:28.040 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-11T17:17:28.040 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-06-11 17:12:03.086662505 +0000 2024-06-11T17:17:28.040 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-06-11 17:12:02.826664824 +0000 2024-06-11T17:17:28.040 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-06-11 17:12:02.826664824 +0000 2024-06-11T17:17:28.040 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2024-06-11T17:17:28.040 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-11T17:17:28.094 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-06-11T17:17:28.095 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-06-11T17:17:28.095 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000385627 s, 1.3 MB/s 2024-06-11T17:17:28.096 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-11T17:17:28.145 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-11T17:17:28.145 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi130.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi172.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-06-11T17:17:28.145 INFO:tasks.ceph:Generating config... 2024-06-11T17:17:28.147 INFO:tasks.ceph:[client] debug ms = 1 2024-06-11T17:17:28.147 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-06-11T17:17:28.147 INFO:tasks.ceph:[global] mon election default strategy = 3 2024-06-11T17:17:28.147 INFO:tasks.ceph:[global] ms bind msgr1 = False 2024-06-11T17:17:28.147 INFO:tasks.ceph:[global] ms bind msgr2 = True 2024-06-11T17:17:28.147 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-06-11T17:17:28.147 INFO:tasks.ceph:[global] ms type = async 2024-06-11T17:17:28.147 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-06-11T17:17:28.147 INFO:tasks.ceph:[mgr] debug ms = 1 2024-06-11T17:17:28.147 INFO:tasks.ceph:[mon] debug mon = 20 2024-06-11T17:17:28.147 INFO:tasks.ceph:[mon] debug ms = 1 2024-06-11T17:17:28.147 INFO:tasks.ceph:[mon] debug paxos = 20 2024-06-11T17:17:28.147 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-06-11T17:17:28.147 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-06-11T17:17:28.148 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-06-11T17:17:28.148 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-06-11T17:17:28.148 INFO:tasks.ceph:[mon] mon scrub interval = 300 2024-06-11T17:17:28.148 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-06-11T17:17:28.148 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-06-11T17:17:28.148 INFO:tasks.ceph:[osd] bluefs allocator = hybrid 2024-06-11T17:17:28.148 INFO:tasks.ceph:[osd] bluestore allocator = hybrid 2024-06-11T17:17:28.148 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-06-11T17:17:28.148 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-06-11T17:17:28.148 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2024-06-11T17:17:28.148 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-06-11T17:17:28.148 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-06-11T17:17:28.148 INFO:tasks.ceph:[osd] debug ms = 1 2024-06-11T17:17:28.148 INFO:tasks.ceph:[osd] debug osd = 20 2024-06-11T17:17:28.149 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-06-11T17:17:28.149 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-06-11T17:17:28.149 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-06-11T17:17:28.149 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-06-11T17:17:28.149 INFO:tasks.ceph:[osd] osd class default list = * 2024-06-11T17:17:28.149 INFO:tasks.ceph:[osd] osd class load list = * 2024-06-11T17:17:28.149 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2024-06-11T17:17:28.149 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2024-06-11T17:17:28.149 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-06-11T17:17:28.149 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2024-06-11T17:17:28.149 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2024-06-11T17:17:28.149 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-06-11T17:17:28.149 INFO:tasks.ceph:[osd] osd op queue = debug_random 2024-06-11T17:17:28.149 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2024-06-11T17:17:28.149 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-06-11T17:17:28.150 INFO:tasks.ceph:Setting up mon.a... 2024-06-11T17:17:28.150 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-06-11T17:17:28.184 INFO:teuthology.orchestra.run.smithi130.stdout:creating /etc/ceph/ceph.keyring 2024-06-11T17:17:28.197 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-06-11T17:17:28.272 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-06-11T17:17:28.326 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.130'), ('mon.c', '[v2:172.21.15.130:3301,v1:172.21.15.130:6790]'), ('mon.b', '172.21.15.172')] 2024-06-11T17:17:28.327 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.130,[v2:172.21.15.130:3301,v1:172.21.15.130:6790],172.21.15.172', 'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-06-11T17:17:28.328 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-06-11T17:17:28.328 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-06-11T17:17:28.376 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.130 --addv c '[v2:172.21.15.130:3301,v1:172.21.15.130:6790]' --add b 172.21.15.172 --print /home/ubuntu/cephtest/ceph.monmap 2024-06-11T17:17:28.463 INFO:teuthology.orchestra.run.smithi130.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-06-11T17:17:28.463 INFO:teuthology.orchestra.run.smithi130.stdout:monmaptool: generated fsid fae1d0b0-28f2-4ebc-8a2f-59aed9de5555 2024-06-11T17:17:28.463 INFO:teuthology.orchestra.run.smithi130.stdout:setting min_mon_release = quincy 2024-06-11T17:17:28.463 INFO:teuthology.orchestra.run.smithi130.stdout:epoch 0 2024-06-11T17:17:28.463 INFO:teuthology.orchestra.run.smithi130.stdout:fsid fae1d0b0-28f2-4ebc-8a2f-59aed9de5555 2024-06-11T17:17:28.463 INFO:teuthology.orchestra.run.smithi130.stdout:last_changed 2024-06-11T17:17:28.467904+0000 2024-06-11T17:17:28.463 INFO:teuthology.orchestra.run.smithi130.stdout:created 2024-06-11T17:17:28.467904+0000 2024-06-11T17:17:28.463 INFO:teuthology.orchestra.run.smithi130.stdout:min_mon_release 17 (quincy) 2024-06-11T17:17:28.463 INFO:teuthology.orchestra.run.smithi130.stdout:election_strategy: 3 2024-06-11T17:17:28.463 INFO:teuthology.orchestra.run.smithi130.stdout:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-06-11T17:17:28.463 INFO:teuthology.orchestra.run.smithi130.stdout:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-06-11T17:17:28.464 INFO:teuthology.orchestra.run.smithi130.stdout:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-06-11T17:17:28.464 INFO:teuthology.orchestra.run.smithi130.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-06-11T17:17:28.465 DEBUG:teuthology.orchestra.run.smithi130:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-06-11T17:17:28.511 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID fae1d0b0-28f2-4ebc-8a2f-59aed9de5555... 2024-06-11T17:17:28.512 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-06-11T17:17:28.557 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-06-11T17:17:28.585 INFO:teuthology.orchestra.run.smithi130.stdout:[global] 2024-06-11T17:17:28.585 INFO:teuthology.orchestra.run.smithi130.stdout: chdir = "" 2024-06-11T17:17:28.585 INFO:teuthology.orchestra.run.smithi130.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-06-11T17:17:28.585 INFO:teuthology.orchestra.run.smithi130.stdout: auth supported = cephx 2024-06-11T17:17:28.585 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:17:28.585 INFO:teuthology.orchestra.run.smithi130.stdout: filestore xattr use omap = true 2024-06-11T17:17:28.586 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:17:28.586 INFO:teuthology.orchestra.run.smithi130.stdout: mon clock drift allowed = 1.000 2024-06-11T17:17:28.586 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:17:28.586 INFO:teuthology.orchestra.run.smithi130.stdout: osd crush chooseleaf type = 0 2024-06-11T17:17:28.586 INFO:teuthology.orchestra.run.smithi130.stdout: auth debug = true 2024-06-11T17:17:28.586 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:17:28.586 INFO:teuthology.orchestra.run.smithi130.stdout: ms die on old message = true 2024-06-11T17:17:28.586 INFO:teuthology.orchestra.run.smithi130.stdout: ms die on bug = true 2024-06-11T17:17:28.586 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:17:28.586 INFO:teuthology.orchestra.run.smithi130.stdout: mon max pg per osd = 10000 # >= luminous 2024-06-11T17:17:28.586 INFO:teuthology.orchestra.run.smithi130.stdout: mon pg warn max object skew = 0 2024-06-11T17:17:28.586 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:17:28.586 INFO:teuthology.orchestra.run.smithi130.stdout: # disable pg_autoscaler by default for new pools 2024-06-11T17:17:28.587 INFO:teuthology.orchestra.run.smithi130.stdout: osd_pool_default_pg_autoscale_mode = off 2024-06-11T17:17:28.587 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:17:28.587 INFO:teuthology.orchestra.run.smithi130.stdout: osd pool default size = 2 2024-06-11T17:17:28.587 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:17:28.587 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd allow primary affinity = true 2024-06-11T17:17:28.587 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd allow pg remap = true 2024-06-11T17:17:28.587 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on legacy crush tunables = false 2024-06-11T17:17:28.587 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on crush straw calc version zero = false 2024-06-11T17:17:28.587 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on no sortbitwise = false 2024-06-11T17:17:28.587 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on osd down out interval zero = false 2024-06-11T17:17:28.587 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on too few osds = false 2024-06-11T17:17:28.587 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-06-11T17:17:28.587 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_pool_no_redundancy = false 2024-06-11T17:17:28.588 INFO:teuthology.orchestra.run.smithi130.stdout: mon_allow_pool_size_one = true 2024-06-11T17:17:28.588 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:17:28.588 INFO:teuthology.orchestra.run.smithi130.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-06-11T17:17:28.588 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:17:28.588 INFO:teuthology.orchestra.run.smithi130.stdout: osd default data pool replay window = 5 2024-06-11T17:17:28.588 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:17:28.588 INFO:teuthology.orchestra.run.smithi130.stdout: mon allow pool delete = true 2024-06-11T17:17:28.588 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:17:28.588 INFO:teuthology.orchestra.run.smithi130.stdout: mon cluster log file level = debug 2024-06-11T17:17:28.588 INFO:teuthology.orchestra.run.smithi130.stdout: debug asserts on shutdown = true 2024-06-11T17:17:28.588 INFO:teuthology.orchestra.run.smithi130.stdout: mon health detail to clog = false 2024-06-11T17:17:28.588 INFO:teuthology.orchestra.run.smithi130.stdout: mon host = "172.21.15.130,[v2:172.21.15.130:3301,v1:172.21.15.130:6790],172.21.15.172" 2024-06-11T17:17:28.588 INFO:teuthology.orchestra.run.smithi130.stdout: mon client directed command retry = 5 2024-06-11T17:17:28.588 INFO:teuthology.orchestra.run.smithi130.stdout: mon election default strategy = 3 2024-06-11T17:17:28.589 INFO:teuthology.orchestra.run.smithi130.stdout: ms bind msgr1 = False 2024-06-11T17:17:28.589 INFO:teuthology.orchestra.run.smithi130.stdout: ms bind msgr2 = True 2024-06-11T17:17:28.589 INFO:teuthology.orchestra.run.smithi130.stdout: ms inject socket failures = 5000 2024-06-11T17:17:28.589 INFO:teuthology.orchestra.run.smithi130.stdout: ms type = async 2024-06-11T17:17:28.589 INFO:teuthology.orchestra.run.smithi130.stdout: fsid = fae1d0b0-28f2-4ebc-8a2f-59aed9de5555 2024-06-11T17:17:28.589 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:17:28.589 INFO:teuthology.orchestra.run.smithi130.stdout:[osd] 2024-06-11T17:17:28.589 INFO:teuthology.orchestra.run.smithi130.stdout: osd journal size = 100 2024-06-11T17:17:28.589 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:17:28.589 INFO:teuthology.orchestra.run.smithi130.stdout: osd scrub load threshold = 5.0 2024-06-11T17:17:28.589 INFO:teuthology.orchestra.run.smithi130.stdout: osd scrub max interval = 600 2024-06-11T17:17:28.589 INFO:teuthology.orchestra.run.smithi130.stdout: osd mclock profile = high_recovery_ops 2024-06-11T17:17:28.589 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:17:28.589 INFO:teuthology.orchestra.run.smithi130.stdout: osd recover clone overlap = true 2024-06-11T17:17:28.590 INFO:teuthology.orchestra.run.smithi130.stdout: osd recovery max chunk = 1048576 2024-06-11T17:17:28.590 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:17:28.590 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug shutdown = true 2024-06-11T17:17:28.590 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug op order = true 2024-06-11T17:17:28.590 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug verify stray on activate = true 2024-06-11T17:17:28.590 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug trim objects = true 2024-06-11T17:17:28.590 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:17:28.590 INFO:teuthology.orchestra.run.smithi130.stdout: osd open classes on start = true 2024-06-11T17:17:28.590 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug pg log writeout = true 2024-06-11T17:17:28.590 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:17:28.590 INFO:teuthology.orchestra.run.smithi130.stdout: osd deep scrub update digest min age = 30 2024-06-11T17:17:28.590 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:17:28.590 INFO:teuthology.orchestra.run.smithi130.stdout: osd map max advance = 10 2024-06-11T17:17:28.590 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:17:28.591 INFO:teuthology.orchestra.run.smithi130.stdout: journal zero on create = true 2024-06-11T17:17:28.591 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:17:28.591 INFO:teuthology.orchestra.run.smithi130.stdout: filestore ondisk finisher threads = 3 2024-06-11T17:17:28.591 INFO:teuthology.orchestra.run.smithi130.stdout: filestore apply finisher threads = 3 2024-06-11T17:17:28.591 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:17:28.591 INFO:teuthology.orchestra.run.smithi130.stdout: bdev debug aio = true 2024-06-11T17:17:28.591 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug misdirected ops = true 2024-06-11T17:17:28.591 INFO:teuthology.orchestra.run.smithi130.stdout: bluefs allocator = hybrid 2024-06-11T17:17:28.591 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore allocator = hybrid 2024-06-11T17:17:28.591 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore block size = 96636764160 2024-06-11T17:17:28.591 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore fsck on mount = True 2024-06-11T17:17:28.591 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore zero block detection = True 2024-06-11T17:17:28.591 INFO:teuthology.orchestra.run.smithi130.stdout: debug bluefs = 20 2024-06-11T17:17:28.591 INFO:teuthology.orchestra.run.smithi130.stdout: debug bluestore = 20 2024-06-11T17:17:28.591 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2024-06-11T17:17:28.592 INFO:teuthology.orchestra.run.smithi130.stdout: debug osd = 20 2024-06-11T17:17:28.592 INFO:teuthology.orchestra.run.smithi130.stdout: debug rocksdb = 10 2024-06-11T17:17:28.592 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd backfillfull_ratio = 0.85 2024-06-11T17:17:28.592 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd full ratio = 0.9 2024-06-11T17:17:28.592 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd nearfull ratio = 0.8 2024-06-11T17:17:28.592 INFO:teuthology.orchestra.run.smithi130.stdout: osd class default list = * 2024-06-11T17:17:28.592 INFO:teuthology.orchestra.run.smithi130.stdout: osd class load list = * 2024-06-11T17:17:28.592 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug verify cached snaps = True 2024-06-11T17:17:28.592 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug verify missing on start = True 2024-06-11T17:17:28.592 INFO:teuthology.orchestra.run.smithi130.stdout: osd failsafe full ratio = 0.95 2024-06-11T17:17:28.592 INFO:teuthology.orchestra.run.smithi130.stdout: osd mclock override recovery settings = True 2024-06-11T17:17:28.592 INFO:teuthology.orchestra.run.smithi130.stdout: osd objectstore = bluestore 2024-06-11T17:17:28.592 INFO:teuthology.orchestra.run.smithi130.stdout: osd op queue = debug_random 2024-06-11T17:17:28.592 INFO:teuthology.orchestra.run.smithi130.stdout: osd op queue cut off = debug_random 2024-06-11T17:17:28.593 INFO:teuthology.orchestra.run.smithi130.stdout: osd shutdown pgref assert = True 2024-06-11T17:17:28.593 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:17:28.593 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr] 2024-06-11T17:17:28.593 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2024-06-11T17:17:28.593 INFO:teuthology.orchestra.run.smithi130.stdout: debug mgr = 20 2024-06-11T17:17:28.593 INFO:teuthology.orchestra.run.smithi130.stdout: debug mon = 20 2024-06-11T17:17:28.593 INFO:teuthology.orchestra.run.smithi130.stdout: debug auth = 20 2024-06-11T17:17:28.593 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min pgs per osd = 4 2024-06-11T17:17:28.593 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min bytes per osd = 10 2024-06-11T17:17:28.593 INFO:teuthology.orchestra.run.smithi130.stdout: mgr/telemetry/nag = false 2024-06-11T17:17:28.593 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:17:28.593 INFO:teuthology.orchestra.run.smithi130.stdout:[mon] 2024-06-11T17:17:28.593 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2024-06-11T17:17:28.593 INFO:teuthology.orchestra.run.smithi130.stdout: debug mon = 20 2024-06-11T17:17:28.594 INFO:teuthology.orchestra.run.smithi130.stdout: debug paxos = 20 2024-06-11T17:17:28.594 INFO:teuthology.orchestra.run.smithi130.stdout: debug auth = 20 2024-06-11T17:17:28.594 INFO:teuthology.orchestra.run.smithi130.stdout: mon data avail warn = 5 2024-06-11T17:17:28.594 INFO:teuthology.orchestra.run.smithi130.stdout: mon mgr mkfs grace = 240 2024-06-11T17:17:28.594 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min pgs per osd = 4 2024-06-11T17:17:28.594 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd reporter subtree level = osd 2024-06-11T17:17:28.594 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd prime pg temp = true 2024-06-11T17:17:28.594 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min bytes per osd = 10 2024-06-11T17:17:28.594 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:17:28.594 INFO:teuthology.orchestra.run.smithi130.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-06-11T17:17:28.594 INFO:teuthology.orchestra.run.smithi130.stdout: auth mon ticket ttl = 660 # 11m 2024-06-11T17:17:28.594 INFO:teuthology.orchestra.run.smithi130.stdout: auth service ticket ttl = 240 # 4m 2024-06-11T17:17:28.594 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:17:28.594 INFO:teuthology.orchestra.run.smithi130.stdout: # don't complain about insecure global_id in the test suite 2024-06-11T17:17:28.595 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-06-11T17:17:28.595 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-06-11T17:17:28.595 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:17:28.595 INFO:teuthology.orchestra.run.smithi130.stdout: # 1m isn't quite enough 2024-06-11T17:17:28.595 INFO:teuthology.orchestra.run.smithi130.stdout: mon_down_mkfs_grace = 2m 2024-06-11T17:17:28.595 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:17:28.595 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_filestore_osds = false 2024-06-11T17:17:28.595 INFO:teuthology.orchestra.run.smithi130.stdout: mon min osdmap epochs = 50 2024-06-11T17:17:28.595 INFO:teuthology.orchestra.run.smithi130.stdout: mon osdmap full prune interval = 2 2024-06-11T17:17:28.595 INFO:teuthology.orchestra.run.smithi130.stdout: mon osdmap full prune min = 15 2024-06-11T17:17:28.595 INFO:teuthology.orchestra.run.smithi130.stdout: mon osdmap full prune txsize = 2 2024-06-11T17:17:28.595 INFO:teuthology.orchestra.run.smithi130.stdout: mon scrub interval = 300 2024-06-11T17:17:28.595 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on pool no app = False 2024-06-11T17:17:28.595 INFO:teuthology.orchestra.run.smithi130.stdout: paxos service trim min = 10 2024-06-11T17:17:28.595 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:17:28.596 INFO:teuthology.orchestra.run.smithi130.stdout:[client] 2024-06-11T17:17:28.596 INFO:teuthology.orchestra.run.smithi130.stdout: rgw cache enabled = true 2024-06-11T17:17:28.596 INFO:teuthology.orchestra.run.smithi130.stdout: rgw enable ops log = true 2024-06-11T17:17:28.596 INFO:teuthology.orchestra.run.smithi130.stdout: rgw enable usage log = true 2024-06-11T17:17:28.596 INFO:teuthology.orchestra.run.smithi130.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-06-11T17:17:28.596 INFO:teuthology.orchestra.run.smithi130.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-06-11T17:17:28.596 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2024-06-11T17:17:28.596 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.a] 2024-06-11T17:17:28.596 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.c] 2024-06-11T17:17:28.596 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.b] 2024-06-11T17:17:28.597 INFO:teuthology.orchestra.run.smithi172.stdout:[global] 2024-06-11T17:17:28.598 INFO:teuthology.orchestra.run.smithi172.stdout: chdir = "" 2024-06-11T17:17:28.598 INFO:teuthology.orchestra.run.smithi172.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-06-11T17:17:28.598 INFO:teuthology.orchestra.run.smithi172.stdout: auth supported = cephx 2024-06-11T17:17:28.598 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-06-11T17:17:28.598 INFO:teuthology.orchestra.run.smithi172.stdout: filestore xattr use omap = true 2024-06-11T17:17:28.598 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-06-11T17:17:28.598 INFO:teuthology.orchestra.run.smithi172.stdout: mon clock drift allowed = 1.000 2024-06-11T17:17:28.598 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-06-11T17:17:28.598 INFO:teuthology.orchestra.run.smithi172.stdout: osd crush chooseleaf type = 0 2024-06-11T17:17:28.598 INFO:teuthology.orchestra.run.smithi172.stdout: auth debug = true 2024-06-11T17:17:28.598 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-06-11T17:17:28.598 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on old message = true 2024-06-11T17:17:28.598 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on bug = true 2024-06-11T17:17:28.599 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-06-11T17:17:28.599 INFO:teuthology.orchestra.run.smithi172.stdout: mon max pg per osd = 10000 # >= luminous 2024-06-11T17:17:28.599 INFO:teuthology.orchestra.run.smithi172.stdout: mon pg warn max object skew = 0 2024-06-11T17:17:28.599 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-06-11T17:17:28.599 INFO:teuthology.orchestra.run.smithi172.stdout: # disable pg_autoscaler by default for new pools 2024-06-11T17:17:28.599 INFO:teuthology.orchestra.run.smithi172.stdout: osd_pool_default_pg_autoscale_mode = off 2024-06-11T17:17:28.599 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-06-11T17:17:28.599 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default size = 2 2024-06-11T17:17:28.599 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-06-11T17:17:28.599 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow primary affinity = true 2024-06-11T17:17:28.599 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow pg remap = true 2024-06-11T17:17:28.599 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on legacy crush tunables = false 2024-06-11T17:17:28.599 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on crush straw calc version zero = false 2024-06-11T17:17:28.599 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on no sortbitwise = false 2024-06-11T17:17:28.599 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on osd down out interval zero = false 2024-06-11T17:17:28.600 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on too few osds = false 2024-06-11T17:17:28.600 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-06-11T17:17:28.600 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_no_redundancy = false 2024-06-11T17:17:28.600 INFO:teuthology.orchestra.run.smithi172.stdout: mon_allow_pool_size_one = true 2024-06-11T17:17:28.600 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-06-11T17:17:28.600 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-06-11T17:17:28.600 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-06-11T17:17:28.600 INFO:teuthology.orchestra.run.smithi172.stdout: osd default data pool replay window = 5 2024-06-11T17:17:28.600 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-06-11T17:17:28.600 INFO:teuthology.orchestra.run.smithi172.stdout: mon allow pool delete = true 2024-06-11T17:17:28.600 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-06-11T17:17:28.600 INFO:teuthology.orchestra.run.smithi172.stdout: mon cluster log file level = debug 2024-06-11T17:17:28.600 INFO:teuthology.orchestra.run.smithi172.stdout: debug asserts on shutdown = true 2024-06-11T17:17:28.600 INFO:teuthology.orchestra.run.smithi172.stdout: mon health detail to clog = false 2024-06-11T17:17:28.601 INFO:teuthology.orchestra.run.smithi172.stdout: mon host = "172.21.15.130,[v2:172.21.15.130:3301,v1:172.21.15.130:6790],172.21.15.172" 2024-06-11T17:17:28.601 INFO:teuthology.orchestra.run.smithi172.stdout: mon client directed command retry = 5 2024-06-11T17:17:28.601 INFO:teuthology.orchestra.run.smithi172.stdout: mon election default strategy = 3 2024-06-11T17:17:28.601 INFO:teuthology.orchestra.run.smithi172.stdout: ms bind msgr1 = False 2024-06-11T17:17:28.601 INFO:teuthology.orchestra.run.smithi172.stdout: ms bind msgr2 = True 2024-06-11T17:17:28.601 INFO:teuthology.orchestra.run.smithi172.stdout: ms inject socket failures = 5000 2024-06-11T17:17:28.601 INFO:teuthology.orchestra.run.smithi172.stdout: ms type = async 2024-06-11T17:17:28.601 INFO:teuthology.orchestra.run.smithi172.stdout: fsid = fae1d0b0-28f2-4ebc-8a2f-59aed9de5555 2024-06-11T17:17:28.601 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-06-11T17:17:28.601 INFO:teuthology.orchestra.run.smithi172.stdout:[osd] 2024-06-11T17:17:28.601 INFO:teuthology.orchestra.run.smithi172.stdout: osd journal size = 100 2024-06-11T17:17:28.601 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-06-11T17:17:28.601 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub load threshold = 5.0 2024-06-11T17:17:28.602 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub max interval = 600 2024-06-11T17:17:28.602 INFO:teuthology.orchestra.run.smithi172.stdout: osd mclock profile = high_recovery_ops 2024-06-11T17:17:28.602 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-06-11T17:17:28.602 INFO:teuthology.orchestra.run.smithi172.stdout: osd recover clone overlap = true 2024-06-11T17:17:28.602 INFO:teuthology.orchestra.run.smithi172.stdout: osd recovery max chunk = 1048576 2024-06-11T17:17:28.602 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-06-11T17:17:28.602 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug shutdown = true 2024-06-11T17:17:28.602 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug op order = true 2024-06-11T17:17:28.602 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug verify stray on activate = true 2024-06-11T17:17:28.602 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug trim objects = true 2024-06-11T17:17:28.602 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-06-11T17:17:28.602 INFO:teuthology.orchestra.run.smithi172.stdout: osd open classes on start = true 2024-06-11T17:17:28.602 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug pg log writeout = true 2024-06-11T17:17:28.603 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-06-11T17:17:28.603 INFO:teuthology.orchestra.run.smithi172.stdout: osd deep scrub update digest min age = 30 2024-06-11T17:17:28.603 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-06-11T17:17:28.603 INFO:teuthology.orchestra.run.smithi172.stdout: osd map max advance = 10 2024-06-11T17:17:28.603 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-06-11T17:17:28.603 INFO:teuthology.orchestra.run.smithi172.stdout: journal zero on create = true 2024-06-11T17:17:28.603 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-06-11T17:17:28.603 INFO:teuthology.orchestra.run.smithi172.stdout: filestore ondisk finisher threads = 3 2024-06-11T17:17:28.603 INFO:teuthology.orchestra.run.smithi172.stdout: filestore apply finisher threads = 3 2024-06-11T17:17:28.603 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-06-11T17:17:28.603 INFO:teuthology.orchestra.run.smithi172.stdout: bdev debug aio = true 2024-06-11T17:17:28.603 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug misdirected ops = true 2024-06-11T17:17:28.603 INFO:teuthology.orchestra.run.smithi172.stdout: bluefs allocator = hybrid 2024-06-11T17:17:28.603 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore allocator = hybrid 2024-06-11T17:17:28.603 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore block size = 96636764160 2024-06-11T17:17:28.604 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore fsck on mount = True 2024-06-11T17:17:28.604 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore zero block detection = True 2024-06-11T17:17:28.604 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluefs = 20 2024-06-11T17:17:28.604 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluestore = 20 2024-06-11T17:17:28.604 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-06-11T17:17:28.604 INFO:teuthology.orchestra.run.smithi172.stdout: debug osd = 20 2024-06-11T17:17:28.604 INFO:teuthology.orchestra.run.smithi172.stdout: debug rocksdb = 10 2024-06-11T17:17:28.604 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd backfillfull_ratio = 0.85 2024-06-11T17:17:28.604 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd full ratio = 0.9 2024-06-11T17:17:28.604 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd nearfull ratio = 0.8 2024-06-11T17:17:28.604 INFO:teuthology.orchestra.run.smithi172.stdout: osd class default list = * 2024-06-11T17:17:28.604 INFO:teuthology.orchestra.run.smithi172.stdout: osd class load list = * 2024-06-11T17:17:28.604 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug verify cached snaps = True 2024-06-11T17:17:28.604 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug verify missing on start = True 2024-06-11T17:17:28.605 INFO:teuthology.orchestra.run.smithi172.stdout: osd failsafe full ratio = 0.95 2024-06-11T17:17:28.605 INFO:teuthology.orchestra.run.smithi172.stdout: osd mclock override recovery settings = True 2024-06-11T17:17:28.605 INFO:teuthology.orchestra.run.smithi172.stdout: osd objectstore = bluestore 2024-06-11T17:17:28.605 INFO:teuthology.orchestra.run.smithi172.stdout: osd op queue = debug_random 2024-06-11T17:17:28.605 INFO:teuthology.orchestra.run.smithi172.stdout: osd op queue cut off = debug_random 2024-06-11T17:17:28.605 INFO:teuthology.orchestra.run.smithi172.stdout: osd shutdown pgref assert = True 2024-06-11T17:17:28.605 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-06-11T17:17:28.605 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr] 2024-06-11T17:17:28.605 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-06-11T17:17:28.605 INFO:teuthology.orchestra.run.smithi172.stdout: debug mgr = 20 2024-06-11T17:17:28.605 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2024-06-11T17:17:28.605 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2024-06-11T17:17:28.605 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2024-06-11T17:17:28.605 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2024-06-11T17:17:28.605 INFO:teuthology.orchestra.run.smithi172.stdout: mgr/telemetry/nag = false 2024-06-11T17:17:28.606 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-06-11T17:17:28.606 INFO:teuthology.orchestra.run.smithi172.stdout:[mon] 2024-06-11T17:17:28.606 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-06-11T17:17:28.606 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2024-06-11T17:17:28.606 INFO:teuthology.orchestra.run.smithi172.stdout: debug paxos = 20 2024-06-11T17:17:28.606 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2024-06-11T17:17:28.606 INFO:teuthology.orchestra.run.smithi172.stdout: mon data avail warn = 5 2024-06-11T17:17:28.606 INFO:teuthology.orchestra.run.smithi172.stdout: mon mgr mkfs grace = 240 2024-06-11T17:17:28.606 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2024-06-11T17:17:28.606 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd reporter subtree level = osd 2024-06-11T17:17:28.606 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd prime pg temp = true 2024-06-11T17:17:28.606 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2024-06-11T17:17:28.606 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-06-11T17:17:28.606 INFO:teuthology.orchestra.run.smithi172.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-06-11T17:17:28.606 INFO:teuthology.orchestra.run.smithi172.stdout: auth mon ticket ttl = 660 # 11m 2024-06-11T17:17:28.607 INFO:teuthology.orchestra.run.smithi172.stdout: auth service ticket ttl = 240 # 4m 2024-06-11T17:17:28.607 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-06-11T17:17:28.607 INFO:teuthology.orchestra.run.smithi172.stdout: # don't complain about insecure global_id in the test suite 2024-06-11T17:17:28.607 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-06-11T17:17:28.607 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-06-11T17:17:28.607 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-06-11T17:17:28.607 INFO:teuthology.orchestra.run.smithi172.stdout: # 1m isn't quite enough 2024-06-11T17:17:28.607 INFO:teuthology.orchestra.run.smithi172.stdout: mon_down_mkfs_grace = 2m 2024-06-11T17:17:28.607 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-06-11T17:17:28.607 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_filestore_osds = false 2024-06-11T17:17:28.607 INFO:teuthology.orchestra.run.smithi172.stdout: mon min osdmap epochs = 50 2024-06-11T17:17:28.607 INFO:teuthology.orchestra.run.smithi172.stdout: mon osdmap full prune interval = 2 2024-06-11T17:17:28.607 INFO:teuthology.orchestra.run.smithi172.stdout: mon osdmap full prune min = 15 2024-06-11T17:17:28.607 INFO:teuthology.orchestra.run.smithi172.stdout: mon osdmap full prune txsize = 2 2024-06-11T17:17:28.607 INFO:teuthology.orchestra.run.smithi172.stdout: mon scrub interval = 300 2024-06-11T17:17:28.608 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on pool no app = False 2024-06-11T17:17:28.608 INFO:teuthology.orchestra.run.smithi172.stdout: paxos service trim min = 10 2024-06-11T17:17:28.608 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-06-11T17:17:28.608 INFO:teuthology.orchestra.run.smithi172.stdout:[client] 2024-06-11T17:17:28.608 INFO:teuthology.orchestra.run.smithi172.stdout: rgw cache enabled = true 2024-06-11T17:17:28.608 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable ops log = true 2024-06-11T17:17:28.608 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable usage log = true 2024-06-11T17:17:28.608 INFO:teuthology.orchestra.run.smithi172.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-06-11T17:17:28.608 INFO:teuthology.orchestra.run.smithi172.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-06-11T17:17:28.608 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-06-11T17:17:28.608 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.a] 2024-06-11T17:17:28.608 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.c] 2024-06-11T17:17:28.608 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.b] 2024-06-11T17:17:28.609 INFO:tasks.ceph:Creating admin key on mon.a... 2024-06-11T17:17:28.609 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-06-11T17:17:28.684 INFO:tasks.ceph:Copying monmap to all nodes... 2024-06-11T17:17:28.684 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-06-11T17:17:28.684 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-06-11T17:17:28.689 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-06-11T17:17:28.689 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-06-11T17:17:28.735 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi130.front.sepia.ceph.com 2024-06-11T17:17:28.735 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-06-11T17:17:28.735 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/ceph/ceph.keyring 2024-06-11T17:17:28.735 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-06-11T17:17:28.800 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-06-11T17:17:28.800 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-06-11T17:17:28.853 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi172.front.sepia.ceph.com 2024-06-11T17:17:28.853 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-06-11T17:17:28.854 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.keyring 2024-06-11T17:17:28.854 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-06-11T17:17:28.876 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-06-11T17:17:28.876 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-06-11T17:17:28.924 INFO:tasks.ceph:Setting up mon nodes... 2024-06-11T17:17:28.925 INFO:tasks.ceph:Setting up mgr nodes... 2024-06-11T17:17:28.925 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-06-11T17:17:28.967 INFO:teuthology.orchestra.run.smithi130.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-06-11T17:17:28.971 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-06-11T17:17:29.014 INFO:teuthology.orchestra.run.smithi172.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-06-11T17:17:29.023 INFO:tasks.ceph:Setting up mds nodes... 2024-06-11T17:17:29.023 INFO:tasks.ceph_client:Setting up client nodes... 2024-06-11T17:17:29.023 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-06-11T17:17:29.060 INFO:teuthology.orchestra.run.smithi130.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-06-11T17:17:29.070 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-06-11T17:17:29.103 INFO:teuthology.orchestra.run.smithi172.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-06-11T17:17:29.114 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-06-11T17:17:29.115 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi130.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi172.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-06-11T17:17:29.115 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-06-11T17:17:29.128 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-11T17:17:29.128 INFO:tasks.ceph:role: osd.0 2024-06-11T17:17:29.128 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi130.front.sepia.ceph.com 2024-06-11T17:17:29.128 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-06-11T17:17:29.191 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-06-11T17:17:29.191 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-11T17:17:29.191 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-11T17:17:29.191 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-06-11T17:17:29.192 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-11T17:17:29.192 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2024-06-11T17:17:29.192 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-11T17:17:29.192 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-06-11T17:17:29.192 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-11T17:17:29.192 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-11T17:17:29.670 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2024-06-11T17:17:29.671 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2024-06-11T17:17:29.672 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-06-11T17:17:29.812 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-06-11T17:17:29.823 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: /sbin/restorecon: command not found 2024-06-11T17:17:29.823 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-11T17:17:29.824 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-06-11T17:17:29.879 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-11T17:17:29.879 INFO:tasks.ceph:role: osd.1 2024-06-11T17:17:29.879 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi130.front.sepia.ceph.com 2024-06-11T17:17:29.880 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-06-11T17:17:29.943 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-06-11T17:17:29.943 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-11T17:17:29.944 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-11T17:17:29.944 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-06-11T17:17:29.944 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-11T17:17:29.944 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2024-06-11T17:17:29.944 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-11T17:17:29.944 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-06-11T17:17:29.944 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-11T17:17:29.944 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-11T17:17:30.389 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2024-06-11T17:17:30.390 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2024-06-11T17:17:30.391 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-06-11T17:17:30.476 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-06-11T17:17:30.528 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-11T17:17:30.529 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: /sbin/restorecon: command not found 2024-06-11T17:17:30.529 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-06-11T17:17:30.581 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-11T17:17:30.581 INFO:tasks.ceph:role: osd.2 2024-06-11T17:17:30.581 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi130.front.sepia.ceph.com 2024-06-11T17:17:30.581 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-06-11T17:17:30.642 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-06-11T17:17:30.642 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-11T17:17:30.642 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-11T17:17:30.642 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-06-11T17:17:30.643 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-11T17:17:30.643 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2024-06-11T17:17:30.643 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-11T17:17:30.643 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-06-11T17:17:30.643 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-11T17:17:30.643 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-11T17:17:31.111 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2024-06-11T17:17:31.113 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2024-06-11T17:17:31.113 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-06-11T17:17:31.238 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-06-11T17:17:31.248 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-11T17:17:31.248 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: /sbin/restorecon: command not found 2024-06-11T17:17:31.249 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-06-11T17:17:31.306 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-11T17:17:31.306 INFO:tasks.ceph:role: osd.3 2024-06-11T17:17:31.306 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi130.front.sepia.ceph.com 2024-06-11T17:17:31.306 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-06-11T17:17:31.367 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-06-11T17:17:31.368 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-11T17:17:31.368 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-11T17:17:31.368 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-06-11T17:17:31.368 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-11T17:17:31.368 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2024-06-11T17:17:31.368 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-11T17:17:31.368 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-06-11T17:17:31.368 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-11T17:17:31.368 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-11T17:17:31.854 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2024-06-11T17:17:31.856 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2024-06-11T17:17:31.856 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-06-11T17:17:32.021 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-06-11T17:17:32.032 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-11T17:17:32.033 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: /sbin/restorecon: command not found 2024-06-11T17:17:32.033 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-11T17:17:32.148 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:17:32.150+0000 7f3f3d67f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-06-11T17:17:32.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:17:32.150+0000 7f3f3d67f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-06-11T17:17:32.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:17:32.150+0000 7f3f3d67f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-06-11T17:17:32.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:17:32.150+0000 7f3f3d67f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-06-11T17:17:32.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:17:32.150+0000 7f3f3d67f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-06-11T17:17:32.152 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:17:32.154+0000 7f3f3d67f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-06-11T17:17:35.136 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-06-11T17:17:35.151 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-11T17:17:35.233 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:17:35.234+0000 7f3766b3e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-06-11T17:17:35.234 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:17:35.234+0000 7f3766b3e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-06-11T17:17:35.234 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:17:35.234+0000 7f3766b3e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-06-11T17:17:35.234 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:17:35.234+0000 7f3766b3e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-06-11T17:17:35.234 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:17:35.234+0000 7f3766b3e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-06-11T17:17:35.235 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:17:35.234+0000 7f3766b3e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-06-11T17:17:38.219 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-06-11T17:17:38.276 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-11T17:17:38.362 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:17:38.362+0000 7f2a691397c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-06-11T17:17:38.363 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:17:38.362+0000 7f2a691397c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-06-11T17:17:38.363 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:17:38.362+0000 7f2a691397c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-06-11T17:17:38.363 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:17:38.362+0000 7f2a691397c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-06-11T17:17:38.363 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:17:38.362+0000 7f2a691397c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-06-11T17:17:38.363 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:17:38.362+0000 7f2a691397c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-06-11T17:17:41.335 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-06-11T17:17:41.393 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-11T17:17:41.475 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:17:41.474+0000 7f211976b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-06-11T17:17:41.476 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:17:41.474+0000 7f211976b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-06-11T17:17:41.476 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:17:41.474+0000 7f211976b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-06-11T17:17:41.476 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:17:41.474+0000 7f211976b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-06-11T17:17:41.476 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:17:41.474+0000 7f211976b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-06-11T17:17:41.477 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:17:41.478+0000 7f211976b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-06-11T17:17:44.444 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-06-11T17:17:44.505 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-06-11T17:17:44.520 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-11T17:17:44.520 INFO:tasks.ceph:role: osd.4 2024-06-11T17:17:44.520 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi172.front.sepia.ceph.com 2024-06-11T17:17:44.520 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-06-11T17:17:44.583 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-06-11T17:17:44.583 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-11T17:17:44.583 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-11T17:17:44.583 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-06-11T17:17:44.583 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-11T17:17:44.583 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2024-06-11T17:17:44.583 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-11T17:17:44.583 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-06-11T17:17:44.583 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-11T17:17:44.583 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-11T17:17:45.037 INFO:teuthology.orchestra.run.smithi172.stdout:Discarding blocks...Done. 2024-06-11T17:17:45.039 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2024-06-11T17:17:45.040 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-06-11T17:17:45.133 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-06-11T17:17:45.142 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-11T17:17:45.142 INFO:teuthology.orchestra.run.smithi172.stderr:sudo: /sbin/restorecon: command not found 2024-06-11T17:17:45.143 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-06-11T17:17:45.193 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-11T17:17:45.193 INFO:tasks.ceph:role: osd.5 2024-06-11T17:17:45.193 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi172.front.sepia.ceph.com 2024-06-11T17:17:45.193 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-06-11T17:17:45.254 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-06-11T17:17:45.254 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-11T17:17:45.254 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-11T17:17:45.254 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-06-11T17:17:45.254 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-11T17:17:45.254 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2024-06-11T17:17:45.255 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-11T17:17:45.255 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-06-11T17:17:45.255 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-11T17:17:45.255 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-11T17:17:45.722 INFO:teuthology.orchestra.run.smithi172.stdout:Discarding blocks...Done. 2024-06-11T17:17:45.724 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2024-06-11T17:17:45.724 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-06-11T17:17:45.881 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-06-11T17:17:45.893 INFO:teuthology.orchestra.run.smithi172.stderr:sudo: /sbin/restorecon: command not found 2024-06-11T17:17:45.893 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-11T17:17:45.894 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-06-11T17:17:45.947 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-11T17:17:45.947 INFO:tasks.ceph:role: osd.6 2024-06-11T17:17:45.947 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi172.front.sepia.ceph.com 2024-06-11T17:17:45.948 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-06-11T17:17:46.011 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-06-11T17:17:46.012 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-11T17:17:46.012 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-11T17:17:46.012 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-06-11T17:17:46.012 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-11T17:17:46.012 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2024-06-11T17:17:46.012 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-11T17:17:46.012 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-06-11T17:17:46.012 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-11T17:17:46.012 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-11T17:17:46.485 INFO:teuthology.orchestra.run.smithi172.stdout:Discarding blocks...Done. 2024-06-11T17:17:46.487 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2024-06-11T17:17:46.487 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-06-11T17:17:46.624 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-06-11T17:17:46.635 INFO:teuthology.orchestra.run.smithi172.stderr:sudo: /sbin/restorecon: command not found 2024-06-11T17:17:46.636 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-11T17:17:46.636 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-06-11T17:17:46.693 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-11T17:17:46.694 INFO:tasks.ceph:role: osd.7 2024-06-11T17:17:46.694 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi172.front.sepia.ceph.com 2024-06-11T17:17:46.694 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-06-11T17:17:46.755 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-06-11T17:17:46.756 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-11T17:17:46.756 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-11T17:17:46.756 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-06-11T17:17:46.756 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-11T17:17:46.756 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2024-06-11T17:17:46.756 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-11T17:17:46.756 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-06-11T17:17:46.756 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-11T17:17:46.756 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-11T17:17:47.182 INFO:teuthology.orchestra.run.smithi172.stdout:Discarding blocks...Done. 2024-06-11T17:17:47.184 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2024-06-11T17:17:47.185 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-06-11T17:17:47.274 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-06-11T17:17:47.284 INFO:teuthology.orchestra.run.smithi172.stderr:sudo: /sbin/restorecon: command not found 2024-06-11T17:17:47.284 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-11T17:17:47.285 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-11T17:17:47.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:17:47.416+0000 7ff0202597c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-06-11T17:17:47.416 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:17:47.420+0000 7ff0202597c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-06-11T17:17:47.416 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:17:47.420+0000 7ff0202597c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-06-11T17:17:47.416 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:17:47.420+0000 7ff0202597c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-06-11T17:17:47.416 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:17:47.420+0000 7ff0202597c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-06-11T17:17:47.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:17:47.420+0000 7ff0202597c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-06-11T17:17:50.388 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-06-11T17:17:50.402 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-11T17:17:50.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:17:50.484+0000 7f8dc43167c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-06-11T17:17:50.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:17:50.484+0000 7f8dc43167c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-06-11T17:17:50.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:17:50.484+0000 7f8dc43167c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-06-11T17:17:50.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:17:50.488+0000 7f8dc43167c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-06-11T17:17:50.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:17:50.488+0000 7f8dc43167c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-06-11T17:17:50.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:17:50.488+0000 7f8dc43167c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-06-11T17:17:53.449 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-06-11T17:17:53.509 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-11T17:17:53.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:17:53.592+0000 7fdfa4fc87c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-06-11T17:17:53.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:17:53.592+0000 7fdfa4fc87c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-06-11T17:17:53.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:17:53.592+0000 7fdfa4fc87c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-06-11T17:17:53.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:17:53.592+0000 7fdfa4fc87c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-06-11T17:17:53.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:17:53.596+0000 7fdfa4fc87c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-06-11T17:17:53.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:17:53.596+0000 7fdfa4fc87c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-06-11T17:17:56.562 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-06-11T17:17:56.615 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-11T17:17:56.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:17:56.695+0000 7fc969f717c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-06-11T17:17:56.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:17:56.699+0000 7fc969f717c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-06-11T17:17:56.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:17:56.699+0000 7fc969f717c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-06-11T17:17:56.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:17:56.699+0000 7fc969f717c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-06-11T17:17:56.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:17:56.699+0000 7fc969f717c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-06-11T17:17:56.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:17:56.699+0000 7fc969f717c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-06-11T17:17:59.674 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-06-11T17:17:59.731 INFO:tasks.ceph:Reading keys from all nodes... 2024-06-11T17:17:59.732 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-06-11T17:17:59.732 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-06-11T17:17:59.746 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-06-11T17:17:59.746 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-06-11T17:17:59.799 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-06-11T17:17:59.799 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-06-11T17:17:59.854 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-06-11T17:17:59.855 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-06-11T17:17:59.911 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-06-11T17:17:59.911 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-06-11T17:17:59.967 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-06-11T17:17:59.967 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-06-11T17:17:59.981 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-06-11T17:17:59.981 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-06-11T17:18:00.035 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-06-11T17:18:00.035 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-06-11T17:18:00.090 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-06-11T17:18:00.090 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-06-11T17:18:00.147 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-06-11T17:18:00.148 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-06-11T17:18:00.203 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-06-11T17:18:00.203 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-06-11T17:18:00.209 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-06-11T17:18:00.209 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-06-11T17:18:00.252 INFO:tasks.ceph:Adding keys to all mons... 2024-06-11T17:18:00.253 DEBUG:teuthology.orchestra.run.smithi130:> sudo tee -a /etc/ceph/ceph.keyring 2024-06-11T17:18:00.256 DEBUG:teuthology.orchestra.run.smithi172:> sudo tee -a /etc/ceph/ceph.keyring 2024-06-11T17:18:00.298 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr.y] 2024-06-11T17:18:00.298 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCohmhmSp77ORAAekPCZpSWxS1KEGhuC3Psqw== 2024-06-11T17:18:00.298 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.0] 2024-06-11T17:18:00.299 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCshmhmf98lCRAARFA+jcKXRXdujQJlzZsY0Q== 2024-06-11T17:18:00.299 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.1] 2024-06-11T17:18:00.299 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCvhmhmWak6DhAA2+mgIfXzK9SJ7r4RxZByVQ== 2024-06-11T17:18:00.299 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.2] 2024-06-11T17:18:00.299 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCyhmhm4DbcFRAA3sIINXvCDZrcxB2xW2B9Lg== 2024-06-11T17:18:00.299 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.3] 2024-06-11T17:18:00.299 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQC1hmhmO+GYHBAAd/WRq0e5lX18p4HthZUfOw== 2024-06-11T17:18:00.299 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr.x] 2024-06-11T17:18:00.300 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCphmhmfL8oARAAHZ8G8H4bUTmUzTqBY2zY0Q== 2024-06-11T17:18:00.300 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.4] 2024-06-11T17:18:00.300 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQC7hmhmPAALGRAAjRPp52ZwS84hSW96Xqw7xQ== 2024-06-11T17:18:00.300 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.5] 2024-06-11T17:18:00.300 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQC+hmhm2MIiHRAAzUE4xsrjc+aQfZoZXLo4qA== 2024-06-11T17:18:00.300 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.6] 2024-06-11T17:18:00.300 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQDBhmhmiLiSIxAA2AH+iSNYow6CmKecFEr7kg== 2024-06-11T17:18:00.300 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.7] 2024-06-11T17:18:00.301 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQDEhmhmC1bOKRAAG0Tpx37ZveGnn4G6Sg/O/w== 2024-06-11T17:18:00.301 INFO:teuthology.orchestra.run.smithi130.stdout:[client.0] 2024-06-11T17:18:00.302 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCphmhmALHeAxAAx0YGtSmYwDl3L7U0wOxCcw== 2024-06-11T17:18:00.302 INFO:teuthology.orchestra.run.smithi130.stdout:[client.1] 2024-06-11T17:18:00.302 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCphmhmubCHBhAATDp2xeFiEaCpkUN/ORBQ0w== 2024-06-11T17:18:00.306 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr.y] 2024-06-11T17:18:00.306 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQCohmhmSp77ORAAekPCZpSWxS1KEGhuC3Psqw== 2024-06-11T17:18:00.306 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.0] 2024-06-11T17:18:00.306 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQCshmhmf98lCRAARFA+jcKXRXdujQJlzZsY0Q== 2024-06-11T17:18:00.306 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.1] 2024-06-11T17:18:00.306 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQCvhmhmWak6DhAA2+mgIfXzK9SJ7r4RxZByVQ== 2024-06-11T17:18:00.306 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.2] 2024-06-11T17:18:00.306 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQCyhmhm4DbcFRAA3sIINXvCDZrcxB2xW2B9Lg== 2024-06-11T17:18:00.307 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.3] 2024-06-11T17:18:00.307 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQC1hmhmO+GYHBAAd/WRq0e5lX18p4HthZUfOw== 2024-06-11T17:18:00.307 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr.x] 2024-06-11T17:18:00.307 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQCphmhmfL8oARAAHZ8G8H4bUTmUzTqBY2zY0Q== 2024-06-11T17:18:00.307 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.4] 2024-06-11T17:18:00.307 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQC7hmhmPAALGRAAjRPp52ZwS84hSW96Xqw7xQ== 2024-06-11T17:18:00.307 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.5] 2024-06-11T17:18:00.307 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQC+hmhm2MIiHRAAzUE4xsrjc+aQfZoZXLo4qA== 2024-06-11T17:18:00.307 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.6] 2024-06-11T17:18:00.307 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQDBhmhmiLiSIxAA2AH+iSNYow6CmKecFEr7kg== 2024-06-11T17:18:00.307 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.7] 2024-06-11T17:18:00.308 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQDEhmhmC1bOKRAAG0Tpx37ZveGnn4G6Sg/O/w== 2024-06-11T17:18:00.308 INFO:teuthology.orchestra.run.smithi172.stdout:[client.0] 2024-06-11T17:18:00.308 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQCphmhmALHeAxAAx0YGtSmYwDl3L7U0wOxCcw== 2024-06-11T17:18:00.308 INFO:teuthology.orchestra.run.smithi172.stdout:[client.1] 2024-06-11T17:18:00.308 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQCphmhmubCHBhAATDp2xeFiEaCpkUN/ORBQ0w== 2024-06-11T17:18:00.309 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-06-11T17:18:00.349 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-06-11T17:18:00.397 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-11T17:18:00.399 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-11T17:18:00.484 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-11T17:18:00.486 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-11T17:18:00.571 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-11T17:18:00.573 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-11T17:18:00.656 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-11T17:18:00.658 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-11T17:18:00.742 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-06-11T17:18:00.744 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-06-11T17:18:00.824 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-11T17:18:00.826 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-11T17:18:00.912 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-11T17:18:00.914 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-11T17:18:00.999 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-11T17:18:01.001 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-11T17:18:01.088 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-11T17:18:01.090 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-11T17:18:01.172 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-11T17:18:01.176 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-11T17:18:01.262 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-11T17:18:01.264 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-11T17:18:01.312 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-06-11T17:18:01.312 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-06-11T17:18:01.323 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-06-11T17:18:01.416 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-06-11T17:18:01.427 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-06-11T17:18:01.480 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-06-11T17:18:01.571 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-06-11T17:18:01.582 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-06-11T17:18:01.596 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-06-11T17:18:01.691 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-06-11T17:18:01.702 DEBUG:teuthology.orchestra.run.smithi130:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-06-11T17:18:01.704 DEBUG:teuthology.orchestra.run.smithi172:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-06-11T17:18:01.747 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-06-11T17:18:01.748 INFO:tasks.ceph.mon.a:Restarting daemon 2024-06-11T17:18:01.748 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-06-11T17:18:01.752 INFO:tasks.ceph.mon.a:Started 2024-06-11T17:18:01.752 INFO:tasks.ceph.mon.c:Restarting daemon 2024-06-11T17:18:01.752 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-06-11T17:18:01.755 INFO:tasks.ceph.mon.c:Started 2024-06-11T17:18:01.755 INFO:tasks.ceph.mon.b:Restarting daemon 2024-06-11T17:18:01.755 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-06-11T17:18:01.792 INFO:tasks.ceph.mon.b:Started 2024-06-11T17:18:01.792 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-06-11T17:18:01.792 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-06-11T17:18:01.792 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-06-11T17:18:01.794 INFO:tasks.ceph.mgr.y:Started 2024-06-11T17:18:01.795 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-06-11T17:18:01.795 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-06-11T17:18:01.797 INFO:tasks.ceph.mgr.x:Started 2024-06-11T17:18:01.797 DEBUG:tasks.ceph:set 0 configs 2024-06-11T17:18:01.797 INFO:tasks.ceph:Setting crush tunables to default 2024-06-11T17:18:01.797 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd crush tunables default 2024-06-11T17:18:01.911 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:01.914+0000 7fadfd6f5640 1 Processor -- start 2024-06-11T17:18:01.912 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:01.914+0000 7fadfd6f5640 1 -- start start 2024-06-11T17:18:01.913 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:01.914+0000 7fadfd6f5640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 0x7fadf80abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:01.913 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:01.914+0000 7fadfd6f5640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 0x7fadf8140310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:01.913 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:01.914+0000 7fadfd6f5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fadf8143070 0x7fadf81434a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:01.913 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:01.914+0000 7fadfd6f5640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fadf806c690 con 0x7fadf813fef0 2024-06-11T17:18:01.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:01.914+0000 7fadfd6f5640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fadf80b0030 con 0x7fadf8143070 2024-06-11T17:18:01.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:01.914+0000 7fadfd6f5640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fadf80ac880 con 0x7fadf806c2b0 2024-06-11T17:18:01.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:01.914+0000 7fadf6ffd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 0x7fadf80abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:01.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:01.914+0000 7fadf67fc640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 0x7fadf8140310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:01.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:01.914+0000 7fadf6ffd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 0x7fadf80abf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:58740/0 (socket says 172.21.15.130:58740) 2024-06-11T17:18:01.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:01.914+0000 7fadf67fc640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 0x7fadf8140310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47434/0 (socket says 172.21.15.130:47434) 2024-06-11T17:18:01.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:01.914+0000 7fadf6ffd640 1 -- 172.21.15.130:0/1723636483 learned_addr learned my addr 172.21.15.130:0/1723636483 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:01.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:01.914+0000 7fadf77fe640 1 --2- 172.21.15.130:0/1723636483 >> v2:172.21.15.172:3300/0 conn(0x7fadf8143070 0x7fadf81434a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:01.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:01.914+0000 7fadf6ffd640 1 -- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 msgr2=0x7fadf80abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-06-11T17:18:01.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:01.914+0000 7fadf6ffd640 1 -- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 msgr2=0x7fadf80abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-11T17:18:01.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:01.914+0000 7fadf6ffd640 1 --2- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 0x7fadf80abf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-11T17:18:01.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:01.914+0000 7fadf67fc640 1 -- 172.21.15.130:0/1723636483 >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 msgr2=0x7fadf8140310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-06-11T17:18:01.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:01.914+0000 7fadf67fc640 1 -- 172.21.15.130:0/1723636483 >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 msgr2=0x7fadf8140310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-11T17:18:01.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:01.914+0000 7fadf67fc640 1 --2- 172.21.15.130:0/1723636483 >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 0x7fadf8140310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-11T17:18:01.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:01.914+0000 7fadf67fc640 1 --2- 172.21.15.130:0/1723636483 >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 0x7fadf8140310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-11T17:18:01.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:01.914+0000 7fadf6ffd640 1 --2- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 0x7fadf80abf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-11T17:18:01.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:01.914+0000 7fadf77fe640 1 -- 172.21.15.130:0/1723636483 >> v2:172.21.15.172:3300/0 conn(0x7fadf8143070 msgr2=0x7fadf81434a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-06-11T17:18:01.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:01.914+0000 7fadf77fe640 1 -- 172.21.15.130:0/1723636483 >> v2:172.21.15.172:3300/0 conn(0x7fadf8143070 msgr2=0x7fadf81434a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-11T17:18:01.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:01.914+0000 7fadf77fe640 1 --2- 172.21.15.130:0/1723636483 >> v2:172.21.15.172:3300/0 conn(0x7fadf8143070 0x7fadf81434a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-11T17:18:01.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:01.914+0000 7fadf77fe640 1 --2- 172.21.15.130:0/1723636483 >> v2:172.21.15.172:3300/0 conn(0x7fadf8143070 0x7fadf81434a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-11T17:18:02.116 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:02.118+0000 7fadf67fc640 1 --2- 172.21.15.130:0/1723636483 >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 0x7fadf8140310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:02.116 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:02.118+0000 7fadf6ffd640 1 --2- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 0x7fadf80abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:02.116 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:02.118+0000 7fadf77fe640 1 --2- 172.21.15.130:0/1723636483 >> v2:172.21.15.172:3300/0 conn(0x7fadf8143070 0x7fadf81434a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:02.116 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:02.118+0000 7fadf67fc640 1 -- 172.21.15.130:0/1723636483 >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 msgr2=0x7fadf8140310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-06-11T17:18:02.116 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:02.118+0000 7fadf67fc640 1 -- 172.21.15.130:0/1723636483 >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 msgr2=0x7fadf8140310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-11T17:18:02.116 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:02.118+0000 7fadf67fc640 1 --2- 172.21.15.130:0/1723636483 >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 0x7fadf8140310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-11T17:18:02.117 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:02.118+0000 7fadf6ffd640 1 -- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 msgr2=0x7fadf80abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-06-11T17:18:02.117 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:02.118+0000 7fadf6ffd640 1 -- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 msgr2=0x7fadf80abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-11T17:18:02.117 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:02.118+0000 7fadf6ffd640 1 --2- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 0x7fadf80abf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-11T17:18:02.117 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:02.118+0000 7fadf67fc640 1 --2- 172.21.15.130:0/1723636483 >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 0x7fadf8140310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-11T17:18:02.117 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:02.118+0000 7fadf77fe640 1 -- 172.21.15.130:0/1723636483 >> v2:172.21.15.172:3300/0 conn(0x7fadf8143070 msgr2=0x7fadf81434a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-06-11T17:18:02.117 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:02.118+0000 7fadf77fe640 1 -- 172.21.15.130:0/1723636483 >> v2:172.21.15.172:3300/0 conn(0x7fadf8143070 msgr2=0x7fadf81434a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-11T17:18:02.117 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:02.118+0000 7fadf77fe640 1 --2- 172.21.15.130:0/1723636483 >> v2:172.21.15.172:3300/0 conn(0x7fadf8143070 0x7fadf81434a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-11T17:18:02.117 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:02.118+0000 7fadf6ffd640 1 --2- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 0x7fadf80abf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-11T17:18:02.117 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:02.118+0000 7fadf77fe640 1 --2- 172.21.15.130:0/1723636483 >> v2:172.21.15.172:3300/0 conn(0x7fadf8143070 0x7fadf81434a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-11T17:18:02.520 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:02.522+0000 7fadf67fc640 1 --2- 172.21.15.130:0/1723636483 >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 0x7fadf8140310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:02.520 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:02.522+0000 7fadf6ffd640 1 --2- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 0x7fadf80abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:02.520 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:02.522+0000 7fadf77fe640 1 --2- 172.21.15.130:0/1723636483 >> v2:172.21.15.172:3300/0 conn(0x7fadf8143070 0x7fadf81434a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:02.520 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:02.522+0000 7fadf67fc640 1 -- 172.21.15.130:0/1723636483 >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 msgr2=0x7fadf8140310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-06-11T17:18:02.520 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:02.522+0000 7fadf67fc640 1 -- 172.21.15.130:0/1723636483 >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 msgr2=0x7fadf8140310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-11T17:18:02.520 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:02.522+0000 7fadf67fc640 1 --2- 172.21.15.130:0/1723636483 >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 0x7fadf8140310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-11T17:18:02.520 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:02.522+0000 7fadf77fe640 1 -- 172.21.15.130:0/1723636483 >> v2:172.21.15.172:3300/0 conn(0x7fadf8143070 msgr2=0x7fadf81434a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-06-11T17:18:02.520 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:02.522+0000 7fadf77fe640 1 -- 172.21.15.130:0/1723636483 >> v2:172.21.15.172:3300/0 conn(0x7fadf8143070 msgr2=0x7fadf81434a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-11T17:18:02.521 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:02.522+0000 7fadf77fe640 1 --2- 172.21.15.130:0/1723636483 >> v2:172.21.15.172:3300/0 conn(0x7fadf8143070 0x7fadf81434a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-11T17:18:02.521 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:02.522+0000 7fadf67fc640 1 --2- 172.21.15.130:0/1723636483 >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 0x7fadf8140310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-06-11T17:18:02.521 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:02.522+0000 7fadf77fe640 1 --2- 172.21.15.130:0/1723636483 >> v2:172.21.15.172:3300/0 conn(0x7fadf8143070 0x7fadf81434a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-06-11T17:18:02.521 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:02.522+0000 7fadf6ffd640 1 -- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 msgr2=0x7fadf80abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-06-11T17:18:02.521 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:02.522+0000 7fadf6ffd640 1 -- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 msgr2=0x7fadf80abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-11T17:18:02.521 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:02.522+0000 7fadf6ffd640 1 --2- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 0x7fadf80abf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-11T17:18:02.521 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:02.522+0000 7fadf6ffd640 1 --2- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 0x7fadf80abf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-06-11T17:18:03.324 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:03.326+0000 7fadf6ffd640 1 --2- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 0x7fadf80abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:03.324 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:03.326+0000 7fadf67fc640 1 --2- 172.21.15.130:0/1723636483 >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 0x7fadf8140310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:03.324 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:03.326+0000 7fadf77fe640 1 --2- 172.21.15.130:0/1723636483 >> v2:172.21.15.172:3300/0 conn(0x7fadf8143070 0x7fadf81434a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:03.324 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:03.326+0000 7fadf6ffd640 1 -- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 msgr2=0x7fadf80abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-06-11T17:18:03.324 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:03.326+0000 7fadf6ffd640 1 -- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 msgr2=0x7fadf80abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-11T17:18:03.324 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:03.326+0000 7fadf6ffd640 1 --2- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 0x7fadf80abf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-11T17:18:03.324 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:03.326+0000 7fadf67fc640 1 -- 172.21.15.130:0/1723636483 >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 msgr2=0x7fadf8140310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-06-11T17:18:03.325 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:03.326+0000 7fadf67fc640 1 -- 172.21.15.130:0/1723636483 >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 msgr2=0x7fadf8140310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-11T17:18:03.325 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:03.326+0000 7fadf67fc640 1 --2- 172.21.15.130:0/1723636483 >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 0x7fadf8140310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-11T17:18:03.325 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:03.326+0000 7fadf6ffd640 1 --2- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 0x7fadf80abf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-06-11T17:18:03.325 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:03.326+0000 7fadf77fe640 1 -- 172.21.15.130:0/1723636483 >> v2:172.21.15.172:3300/0 conn(0x7fadf8143070 msgr2=0x7fadf81434a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-06-11T17:18:03.325 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:03.326+0000 7fadf77fe640 1 -- 172.21.15.130:0/1723636483 >> v2:172.21.15.172:3300/0 conn(0x7fadf8143070 msgr2=0x7fadf81434a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-11T17:18:03.325 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:03.326+0000 7fadf77fe640 1 --2- 172.21.15.130:0/1723636483 >> v2:172.21.15.172:3300/0 conn(0x7fadf8143070 0x7fadf81434a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-11T17:18:03.325 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:03.326+0000 7fadf67fc640 1 --2- 172.21.15.130:0/1723636483 >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 0x7fadf8140310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-06-11T17:18:03.325 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:03.326+0000 7fadf77fe640 1 --2- 172.21.15.130:0/1723636483 >> v2:172.21.15.172:3300/0 conn(0x7fadf8143070 0x7fadf81434a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-06-11T17:18:04.912 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:04.914+0000 7fadf4ff9640 1 -- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 msgr2=0x7fadf80abf90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-11T17:18:04.913 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:04.914+0000 7fadf4ff9640 1 --2- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 0x7fadf80abf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:04.913 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:04.914+0000 7fadf4ff9640 1 -- 172.21.15.130:0/1723636483 >> v2:172.21.15.172:3300/0 conn(0x7fadf8143070 msgr2=0x7fadf81434a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-11T17:18:04.913 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:04.914+0000 7fadf4ff9640 1 --2- 172.21.15.130:0/1723636483 >> v2:172.21.15.172:3300/0 conn(0x7fadf8143070 0x7fadf81434a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:04.913 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:04.914+0000 7fadf4ff9640 1 -- 172.21.15.130:0/1723636483 >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 msgr2=0x7fadf8140310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-11T17:18:04.913 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:04.914+0000 7fadf4ff9640 1 --2- 172.21.15.130:0/1723636483 >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 0x7fadf8140310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:04.913 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:04.914+0000 7fadf4ff9640 1 -- 172.21.15.130:0/1723636483 --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadf80ab5b0 con 0x7fade40036d0 2024-06-11T17:18:04.913 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:04.914+0000 7fadf4ff9640 1 -- 172.21.15.130:0/1723636483 --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fade400c080 con 0x7fade4007380 2024-06-11T17:18:07.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:07.914+0000 7fadf4ff9640 1 -- 172.21.15.130:0/1723636483 >> v1:172.21.15.172:6789/0 conn(0x7fade4007380 legacy=0x7fade4009800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:07.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:07.914+0000 7fadf4ff9640 1 -- 172.21.15.130:0/1723636483 >> v1:172.21.15.130:6789/0 conn(0x7fade40036d0 legacy=0x7fade4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:07.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:07.914+0000 7fadf4ff9640 1 --2- 172.21.15.130:0/1723636483 >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 0x7fade400c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:07.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:07.914+0000 7fadf77fe640 1 -- 172.21.15.130:0/1723636483 reap_dead start 2024-06-11T17:18:07.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:07.914+0000 7fadf4ff9640 1 --2- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 0x7fade4005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:07.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:07.914+0000 7fadf4ff9640 1 -- 172.21.15.130:0/1723636483 --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fade400d2e0 con 0x7fade400c960 2024-06-11T17:18:07.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:07.914+0000 7fadf4ff9640 1 -- 172.21.15.130:0/1723636483 --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fadf80ac880 con 0x7fadf813fef0 2024-06-11T17:18:07.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:07.914+0000 7fadf4ff9640 1 -- 172.21.15.130:0/1723636483 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fade400cfa0 con 0x7fadf806c2b0 2024-06-11T17:18:07.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:07.914+0000 7fadf6ffd640 1 --2- 172.21.15.130:0/1723636483 >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 0x7fade400c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:07.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:07.914+0000 7fadf77fe640 1 --2- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 0x7fade4005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:07.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:07.914+0000 7fadf6ffd640 1 -- 172.21.15.130:0/1723636483 >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 msgr2=0x7fade400c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-06-11T17:18:07.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:07.914+0000 7fadf6ffd640 1 -- 172.21.15.130:0/1723636483 >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 msgr2=0x7fade400c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-11T17:18:07.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:07.914+0000 7fadf6ffd640 1 --2- 172.21.15.130:0/1723636483 >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 0x7fade400c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-11T17:18:07.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:07.914+0000 7fadf6ffd640 1 --2- 172.21.15.130:0/1723636483 >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 0x7fade400c400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-11T17:18:07.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:07.914+0000 7fadf77fe640 1 -- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 msgr2=0x7fade4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-06-11T17:18:07.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:07.914+0000 7fadf77fe640 1 -- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 msgr2=0x7fade4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-11T17:18:07.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:07.914+0000 7fadf77fe640 1 --2- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 0x7fade4005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-11T17:18:07.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:07.914+0000 7fadf77fe640 1 --2- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 0x7fade4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-11T17:18:08.116 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.118+0000 7fadf77fe640 1 --2- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 0x7fade4005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:08.116 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.118+0000 7fadf6ffd640 1 --2- 172.21.15.130:0/1723636483 >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 0x7fade400c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:08.117 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.118+0000 7fadf77fe640 1 -- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 msgr2=0x7fade4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-06-11T17:18:08.117 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.118+0000 7fadf6ffd640 1 -- 172.21.15.130:0/1723636483 >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 msgr2=0x7fade400c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-06-11T17:18:08.117 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.118+0000 7fadf77fe640 1 -- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 msgr2=0x7fade4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-11T17:18:08.117 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.118+0000 7fadf77fe640 1 --2- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 0x7fade4005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-11T17:18:08.117 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.118+0000 7fadf6ffd640 1 -- 172.21.15.130:0/1723636483 >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 msgr2=0x7fade400c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-11T17:18:08.118 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.118+0000 7fadf6ffd640 1 --2- 172.21.15.130:0/1723636483 >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 0x7fade400c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-11T17:18:08.118 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.118+0000 7fadf77fe640 1 --2- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 0x7fade4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-11T17:18:08.118 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.118+0000 7fadf6ffd640 1 --2- 172.21.15.130:0/1723636483 >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 0x7fade400c400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-11T17:18:08.160 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.162+0000 7fadf5ffb640 1 -- 172.21.15.130:0/1723636483 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2427002476 0 0) 0x7fade400d2e0 con 0x7fade400c960 2024-06-11T17:18:08.160 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.162+0000 7fadf5ffb640 1 -- 172.21.15.130:0/1723636483 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadd8003530 con 0x7fade400c960 2024-06-11T17:18:08.161 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.162+0000 7fadf5ffb640 1 -- 172.21.15.130:0/1723636483 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 936567634 0 0) 0x7fadd8003530 con 0x7fade400c960 2024-06-11T17:18:08.162 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.162+0000 7fadf5ffb640 1 -- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 msgr2=0x7fade4005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-11T17:18:08.162 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.162+0000 7fadf5ffb640 1 --2- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 0x7fade4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:08.162 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.162+0000 7fadf5ffb640 1 -- 172.21.15.130:0/1723636483 >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 msgr2=0x7fade400c400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-11T17:18:08.162 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.162+0000 7fadf5ffb640 1 --2- 172.21.15.130:0/1723636483 >> v2:172.21.15.130:3300/0 conn(0x7fadf813fef0 0x7fade400c400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:08.162 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.162+0000 7fadf5ffb640 1 -- 172.21.15.130:0/1723636483 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade400b780 con 0x7fade400c960 2024-06-11T17:18:08.162 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.162+0000 7fadf5ffb640 1 -- 172.21.15.130:0/1723636483 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3158545239 0 0) 0x7fade000f040 con 0x7fade400c960 2024-06-11T17:18:08.162 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.162+0000 7fadf5ffb640 1 -- 172.21.15.130:0/1723636483 >> v1:172.21.15.130:6789/0 conn(0x7fade400c960 legacy=0x7fade400b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:08.162 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.162+0000 7fadf5ffb640 1 --2- 172.21.15.130:0/1723636483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fadd80039c0 0x7fadd8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:08.162 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.162+0000 7fadf5ffb640 1 --2- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fadd8004810 0x7fadd8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:08.162 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.162+0000 7fadf5ffb640 1 --2- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 0x7fadd80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:08.162 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.162+0000 7fadf5ffb640 1 -- 172.21.15.130:0/1723636483 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fadf80ac880 con 0x7fadd8004810 2024-06-11T17:18:08.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.162+0000 7fadf5ffb640 1 -- 172.21.15.130:0/1723636483 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fade400cfa0 con 0x7fadd80039c0 2024-06-11T17:18:08.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.162+0000 7fadf5ffb640 1 -- 172.21.15.130:0/1723636483 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fadd800bb30 con 0x7fadf806c2b0 2024-06-11T17:18:08.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.162+0000 7fadf77fe640 1 --2- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 0x7fadd80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:08.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.162+0000 7fadf6ffd640 1 --2- 172.21.15.130:0/1723636483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fadd80039c0 0x7fadd8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:08.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.162+0000 7fadf67fc640 1 --2- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fadd8004810 0x7fadd8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:08.164 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.162+0000 7fadf6ffd640 1 -- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 msgr2=0x7fadd80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:08.164 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.162+0000 7fadf6ffd640 1 --2- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf806c2b0 0x7fadd80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:08.164 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.162+0000 7fadf6ffd640 1 -- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fadd8004810 msgr2=0x7fadd8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:08.164 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.162+0000 7fadf6ffd640 1 --2- 172.21.15.130:0/1723636483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fadd8004810 0x7fadd8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:08.164 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.162+0000 7fadf6ffd640 1 -- 172.21.15.130:0/1723636483 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade400b780 con 0x7fadd80039c0 2024-06-11T17:18:08.169 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.170+0000 7fadf6ffd640 1 --2- 172.21.15.130:0/1723636483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fadd80039c0 0x7fadd8003de0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fade4007290 tx=0x7fade801dbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a644250eeeac1b13 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:08.169 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.170+0000 7fadf5ffb640 1 -- 172.21.15.130:0/1723636483 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade800f040 con 0x7fadd80039c0 2024-06-11T17:18:08.169 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.170+0000 7fadf5ffb640 1 -- 172.21.15.130:0/1723636483 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fade80a6af0 con 0x7fadd80039c0 2024-06-11T17:18:08.169 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.170+0000 7fadf5ffb640 1 -- 172.21.15.130:0/1723636483 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade80b1480 con 0x7fadd80039c0 2024-06-11T17:18:08.171 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.174+0000 7fadfd6f5640 1 -- 172.21.15.130:0/1723636483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fadd80039c0 msgr2=0x7fadd8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:08.171 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.174+0000 7fadfd6f5640 1 --2- 172.21.15.130:0/1723636483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fadd80039c0 0x7fadd8003de0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fade4007290 tx=0x7fade801dbb0 comp rx=0 tx=0).stop 2024-06-11T17:18:08.173 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.174+0000 7fadf77fe640 1 -- 172.21.15.130:0/1723636483 reap_dead start 2024-06-11T17:18:08.173 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.174+0000 7fadfd6f5640 1 -- 172.21.15.130:0/1723636483 shutdown_connections 2024-06-11T17:18:08.173 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.174+0000 7fadfd6f5640 1 -- 172.21.15.130:0/1723636483 >> 172.21.15.130:0/1723636483 conn(0x7fadf806d160 msgr2=0x7fadf806d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:08.173 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.174+0000 7fadfd6f5640 1 -- 172.21.15.130:0/1723636483 shutdown_connections 2024-06-11T17:18:08.173 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.174+0000 7fadfd6f5640 1 -- 172.21.15.130:0/1723636483 wait complete. 2024-06-11T17:18:08.174 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.174+0000 7fadfd6f5640 1 Processor -- start 2024-06-11T17:18:08.175 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.174+0000 7fadfd6f5640 1 -- start start 2024-06-11T17:18:08.177 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.178+0000 7fadfd6f5640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf80af190 0x7fadf81db590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:08.177 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.178+0000 7fadfd6f5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fadf80717b0 0x7fadf80725a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:08.177 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.178+0000 7fadfd6f5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fadf813c4c0 0x7fadf813c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:08.177 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.178+0000 7fadfd6f5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fadf81438d0 con 0x7fadf813c4c0 2024-06-11T17:18:08.177 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.178+0000 7fadfd6f5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fadf8143750 con 0x7fadf80717b0 2024-06-11T17:18:08.177 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.178+0000 7fadfd6f5640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fadf8143a50 con 0x7fadf80af190 2024-06-11T17:18:08.177 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.178+0000 7fadf77fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fadf813c4c0 0x7fadf813c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:08.178 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.178+0000 7fadf6ffd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf80af190 0x7fadf81db590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:08.178 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.178+0000 7fadf77fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fadf813c4c0 0x7fadf813c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47562/0 (socket says 172.21.15.130:47562) 2024-06-11T17:18:08.178 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.178+0000 7fadf6ffd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf80af190 0x7fadf81db590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:58888/0 (socket says 172.21.15.130:58888) 2024-06-11T17:18:08.178 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.178+0000 7fadf77fe640 1 -- 172.21.15.130:0/1659296993 learned_addr learned my addr 172.21.15.130:0/1659296993 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:08.178 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.178+0000 7fadf67fc640 1 --2- 172.21.15.130:0/1659296993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fadf80717b0 0x7fadf80725a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:08.178 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.178+0000 7fadf77fe640 1 -- 172.21.15.130:0/1659296993 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf80af190 msgr2=0x7fadf81db590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:08.178 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.178+0000 7fadf77fe640 1 --2- 172.21.15.130:0/1659296993 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf80af190 0x7fadf81db590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:08.178 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.178+0000 7fadf77fe640 1 -- 172.21.15.130:0/1659296993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fadf80717b0 msgr2=0x7fadf80725a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:08.178 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.178+0000 7fadf77fe640 1 --2- 172.21.15.130:0/1659296993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fadf80717b0 0x7fadf80725a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:08.178 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.178+0000 7fadf77fe640 1 -- 172.21.15.130:0/1659296993 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf813ce80 con 0x7fadf813c4c0 2024-06-11T17:18:08.178 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.178+0000 7fadf6ffd640 1 --2- 172.21.15.130:0/1659296993 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf80af190 0x7fadf81db590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:18:08.178 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.178+0000 7fadf67fc640 1 --2- 172.21.15.130:0/1659296993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fadf80717b0 0x7fadf80725a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:18:08.179 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.178+0000 7fadf77fe640 1 --2- 172.21.15.130:0/1659296993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fadf813c4c0 0x7fadf813c940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fadf0009610 tx=0x7fadf0016770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:08.179 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.178+0000 7fadef7fe640 1 -- 172.21.15.130:0/1659296993 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf0016e40 con 0x7fadf813c4c0 2024-06-11T17:18:08.179 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.178+0000 7fadef7fe640 1 -- 172.21.15.130:0/1659296993 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadf0014540 con 0x7fadf813c4c0 2024-06-11T17:18:08.179 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.178+0000 7fadfd6f5640 1 -- 172.21.15.130:0/1659296993 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadf8072080 con 0x7fadf813c4c0 2024-06-11T17:18:08.179 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.178+0000 7fadef7fe640 1 -- 172.21.15.130:0/1659296993 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf0014930 con 0x7fadf813c4c0 2024-06-11T17:18:08.179 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.178+0000 7fadfd6f5640 1 -- 172.21.15.130:0/1659296993 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadf8072ae0 con 0x7fadf813c4c0 2024-06-11T17:18:08.179 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.178+0000 7fadef7fe640 1 -- 172.21.15.130:0/1659296993 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fadf0015040 con 0x7fadf813c4c0 2024-06-11T17:18:08.179 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.178+0000 7fadef7fe640 1 -- 172.21.15.130:0/1659296993 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fadf0020700 con 0x7fadf813c4c0 2024-06-11T17:18:08.179 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.178+0000 7fadfd6f5640 1 -- 172.21.15.130:0/1659296993 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadf8146320 con 0x7fadf813c4c0 2024-06-11T17:18:08.180 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.182+0000 7fadef7fe640 1 -- 172.21.15.130:0/1659296993 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fadf0010040 con 0x7fadf813c4c0 2024-06-11T17:18:08.247 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.250+0000 7fadfd6f5640 1 -- 172.21.15.130:0/1659296993 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fadf80b1da0 con 0x7fadf813c4c0 2024-06-11T17:18:08.252 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.254+0000 7fadef7fe640 1 -- 172.21.15.130:0/1659296993 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fadf0020900 con 0x7fadf813c4c0 2024-06-11T17:18:08.252 INFO:teuthology.orchestra.run.smithi130.stderr:adjusted tunables profile to default 2024-06-11T17:18:08.253 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.254+0000 7fadfd6f5640 1 -- 172.21.15.130:0/1659296993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fadf813c4c0 msgr2=0x7fadf813c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:08.254 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.254+0000 7fadfd6f5640 1 --2- 172.21.15.130:0/1659296993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fadf813c4c0 0x7fadf813c940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fadf0009610 tx=0x7fadf0016770 comp rx=0 tx=0).stop 2024-06-11T17:18:08.254 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.254+0000 7fadfd6f5640 1 -- 172.21.15.130:0/1659296993 shutdown_connections 2024-06-11T17:18:08.254 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.254+0000 7fadfd6f5640 1 --2- 172.21.15.130:0/1659296993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fadf813c4c0 0x7fadf813c940 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:08.254 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.254+0000 7fadfd6f5640 1 --2- 172.21.15.130:0/1659296993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fadf80717b0 0x7fadf80725a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:08.254 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.254+0000 7fadfd6f5640 1 --2- 172.21.15.130:0/1659296993 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadf80af190 0x7fadf81db590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:08.254 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.254+0000 7fadfd6f5640 1 -- 172.21.15.130:0/1659296993 >> 172.21.15.130:0/1659296993 conn(0x7fadf806d160 msgr2=0x7fadf81416e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:08.254 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.254+0000 7fadfd6f5640 1 -- 172.21.15.130:0/1659296993 shutdown_connections 2024-06-11T17:18:08.254 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:08.254+0000 7fadfd6f5640 1 -- 172.21.15.130:0/1659296993 wait complete. 2024-06-11T17:18:08.271 INFO:tasks.ceph:check_enable_crimson: False 2024-06-11T17:18:08.271 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-06-11T17:18:08.271 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-06-11T17:18:08.271 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-06-11T17:18:08.282 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-06-11T17:18:08.282 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-06-11T17:18:08.337 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-06-11T17:18:08.337 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-06-11T17:18:08.355 INFO:tasks.ceph.mgr.y.smithi130.stderr:2024-06-11T17:18:08.354+0000 7f8618fdb180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-11T17:18:08.365 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-06-11T17:18:08.365 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-06-11T17:18:08.418 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-06-11T17:18:08.418 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-06-11T17:18:08.432 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-06-11T17:18:08.433 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-06-11T17:18:08.435 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-06-11T17:18:08.439+0000 7f5588203180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-11T17:18:08.447 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-06-11T17:18:08.447 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-06-11T17:18:08.506 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-06-11T17:18:08.507 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-06-11T17:18:08.563 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 0bb385e4-fde4-44a5-a9ca-491e3a80dd65 0 2024-06-11T17:18:08.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.731+0000 7f0942762640 1 Processor -- start 2024-06-11T17:18:08.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.731+0000 7f0942762640 1 -- start start 2024-06-11T17:18:08.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.731+0000 7f0942762640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f093c062cd0 0x7f093c0729e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:08.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.731+0000 7f0942762640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f093c13dbf0 0x7f093c13e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:08.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.731+0000 7f0942762640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f093c13e5c0 con 0x7f093c074300 2024-06-11T17:18:08.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.731+0000 7f0942762640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f093c0630b0 con 0x7f093c062cd0 2024-06-11T17:18:08.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.731+0000 7f0942762640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f093c144650 con 0x7f093c13dbf0 2024-06-11T17:18:08.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.731+0000 7f093bfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f093c062cd0 0x7f093c0729e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:08.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.731+0000 7f093bfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f093c062cd0 0x7f093c0729e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33730/0 (socket says 172.21.15.172:33730) 2024-06-11T17:18:08.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.731+0000 7f093bfff640 1 -- 172.21.15.172:0/567569297 learned_addr learned my addr 172.21.15.172:0/567569297 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-06-11T17:18:08.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.731+0000 7f093bfff640 1 -- 172.21.15.172:0/567569297 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f093c13dbf0 msgr2=0x7f093c13e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:08.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.731+0000 7f093bfff640 1 --2- 172.21.15.172:0/567569297 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f093c13dbf0 0x7f093c13e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:08.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.731+0000 7f093bfff640 1 -- 172.21.15.172:0/567569297 >> v1:172.21.15.130:6789/0 conn(0x7f093c074300 legacy=0x7f093c143f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:08.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.731+0000 7f093bfff640 1 -- 172.21.15.172:0/567569297 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f093c0af3e0 con 0x7f093c062cd0 2024-06-11T17:18:08.732 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f093bfff640 1 --2- 172.21.15.172:0/567569297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f093c062cd0 0x7f093c0729e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f092c009870 tx=0x7f092c01c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf05aec320156025 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:08.732 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f093affd640 1 -- 172.21.15.172:0/567569297 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f092c0b0070 con 0x7f093c062cd0 2024-06-11T17:18:08.732 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f093affd640 1 -- 172.21.15.172:0/567569297 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f092c0ab600 con 0x7f093c062cd0 2024-06-11T17:18:08.732 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f093affd640 1 -- 172.21.15.172:0/567569297 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f092c0ab9d0 con 0x7f093c062cd0 2024-06-11T17:18:08.732 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f0942762640 1 -- 172.21.15.172:0/567569297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f093c062cd0 msgr2=0x7f093c0729e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:08.732 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f0942762640 1 --2- 172.21.15.172:0/567569297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f093c062cd0 0x7f093c0729e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f092c009870 tx=0x7f092c01c540 comp rx=0 tx=0).stop 2024-06-11T17:18:08.732 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f0942762640 1 -- 172.21.15.172:0/567569297 shutdown_connections 2024-06-11T17:18:08.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f0942762640 1 --2- 172.21.15.172:0/567569297 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f093c13dbf0 0x7f093c13e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:08.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f0942762640 1 --2- 172.21.15.172:0/567569297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f093c062cd0 0x7f093c0729e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:08.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f0942762640 1 -- 172.21.15.172:0/567569297 >> 172.21.15.172:0/567569297 conn(0x7f093c0b4fd0 msgr2=0x7f093c0b53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:08.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f0942762640 1 -- 172.21.15.172:0/567569297 shutdown_connections 2024-06-11T17:18:08.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f0942762640 1 -- 172.21.15.172:0/567569297 wait complete. 2024-06-11T17:18:08.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f0942762640 1 Processor -- start 2024-06-11T17:18:08.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f0942762640 1 -- start start 2024-06-11T17:18:08.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f0942762640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f093c062cd0 0x7f093c145090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:08.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f0942762640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f093c074300 0x7f093c0ad380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:08.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f0942762640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f093c13dbf0 0x7f093c146680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:08.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f0942762640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f093c14de80 con 0x7f093c13dbf0 2024-06-11T17:18:08.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f0942762640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f093c14dd00 con 0x7f093c074300 2024-06-11T17:18:08.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f0942762640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f093c14e000 con 0x7f093c062cd0 2024-06-11T17:18:08.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f093b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f093c074300 0x7f093c0ad380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:08.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f093b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f093c074300 0x7f093c0ad380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33744/0 (socket says 172.21.15.172:33744) 2024-06-11T17:18:08.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f093b7fe640 1 -- 172.21.15.172:0/2027043458 learned_addr learned my addr 172.21.15.172:0/2027043458 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-06-11T17:18:08.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f0940cff640 1 --2- 172.21.15.172:0/2027043458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f093c13dbf0 0x7f093c146680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:08.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f093bfff640 1 --2- 172.21.15.172:0/2027043458 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f093c062cd0 0x7f093c145090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:08.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f093b7fe640 1 -- 172.21.15.172:0/2027043458 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f093c062cd0 msgr2=0x7f093c145090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:08.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f093b7fe640 1 --2- 172.21.15.172:0/2027043458 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f093c062cd0 0x7f093c145090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:08.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f093b7fe640 1 -- 172.21.15.172:0/2027043458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f093c13dbf0 msgr2=0x7f093c146680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:08.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f093b7fe640 1 --2- 172.21.15.172:0/2027043458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f093c13dbf0 0x7f093c146680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:08.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f093b7fe640 1 -- 172.21.15.172:0/2027043458 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f093c148a00 con 0x7f093c074300 2024-06-11T17:18:08.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f093b7fe640 1 --2- 172.21.15.172:0/2027043458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f093c074300 0x7f093c0ad380 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f093000c450 tx=0x7f093000c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:08.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f0938ff9640 1 -- 172.21.15.172:0/2027043458 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0930011790 con 0x7f093c074300 2024-06-11T17:18:08.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f0938ff9640 1 -- 172.21.15.172:0/2027043458 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0930017070 con 0x7f093c074300 2024-06-11T17:18:08.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f0942762640 1 -- 172.21.15.172:0/2027043458 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f093c148ce0 con 0x7f093c074300 2024-06-11T17:18:08.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f0938ff9640 1 -- 172.21.15.172:0/2027043458 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0930011b90 con 0x7f093c074300 2024-06-11T17:18:08.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f0942762640 1 -- 172.21.15.172:0/2027043458 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f093c147290 con 0x7f093c074300 2024-06-11T17:18:08.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f0938ff9640 1 -- 172.21.15.172:0/2027043458 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0930011d30 con 0x7f093c074300 2024-06-11T17:18:08.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.735+0000 7f0938ff9640 1 -- 172.21.15.172:0/2027043458 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f09300127b0 con 0x7f093c074300 2024-06-11T17:18:08.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.739+0000 7f0942762640 1 -- 172.21.15.172:0/2027043458 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f093c147020 con 0x7f093c074300 2024-06-11T17:18:08.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.747+0000 7f0938ff9640 1 -- 172.21.15.172:0/2027043458 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f093c147020 con 0x7f093c074300 2024-06-11T17:18:08.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.831+0000 7f0942762640 1 -- 172.21.15.172:0/2027043458 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0bb385e4-fde4-44a5-a9ca-491e3a80dd65", "id": 0} v 0) -- 0x7f093c0729c0 con 0x7f093c074300 2024-06-11T17:18:08.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.835+0000 7f0938ff9640 1 -- 172.21.15.172:0/2027043458 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0bb385e4-fde4-44a5-a9ca-491e3a80dd65", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f0930012b10 con 0x7f093c074300 2024-06-11T17:18:08.834 INFO:teuthology.orchestra.run.smithi172.stdout:0 2024-06-11T17:18:08.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.839+0000 7f0942762640 1 -- 172.21.15.172:0/2027043458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f093c074300 msgr2=0x7f093c0ad380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:08.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.839+0000 7f0942762640 1 --2- 172.21.15.172:0/2027043458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f093c074300 0x7f093c0ad380 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f093000c450 tx=0x7f093000c910 comp rx=0 tx=0).stop 2024-06-11T17:18:08.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.839+0000 7f0942762640 1 -- 172.21.15.172:0/2027043458 shutdown_connections 2024-06-11T17:18:08.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.839+0000 7f0942762640 1 --2- 172.21.15.172:0/2027043458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f093c13dbf0 0x7f093c146680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:08.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.839+0000 7f0942762640 1 --2- 172.21.15.172:0/2027043458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f093c074300 0x7f093c0ad380 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:08.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.839+0000 7f0942762640 1 --2- 172.21.15.172:0/2027043458 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f093c062cd0 0x7f093c145090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:08.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.839+0000 7f0942762640 1 -- 172.21.15.172:0/2027043458 >> 172.21.15.172:0/2027043458 conn(0x7f093c0b4fd0 msgr2=0x7f093c13e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:08.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.839+0000 7f0942762640 1 -- 172.21.15.172:0/2027043458 shutdown_connections 2024-06-11T17:18:08.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.839+0000 7f0942762640 1 -- 172.21.15.172:0/2027043458 wait complete. 2024-06-11T17:18:08.853 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new b96b90b9-e209-41df-9235-5ee65fc63857 1 2024-06-11T17:18:08.855 INFO:tasks.ceph.mgr.y.smithi130.stderr:2024-06-11T17:18:08.858+0000 7f8618fdb180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-11T17:18:08.969 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.971+0000 7fa15b343640 1 Processor -- start 2024-06-11T17:18:08.969 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.971+0000 7fa15b343640 1 -- start start 2024-06-11T17:18:08.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.971+0000 7fa15b343640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa154141240 0x7fa15414c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:08.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.971+0000 7fa15b343640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa154073790 con 0x7fa154071bf0 2024-06-11T17:18:08.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.971+0000 7fa15b343640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa154073a70 con 0x7fa154071810 2024-06-11T17:18:08.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.971+0000 7fa15b343640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fa154073d50 con 0x7fa154141240 2024-06-11T17:18:08.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.971+0000 7fa1598e0640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa154141240 0x7fa15414c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:08.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.971+0000 7fa1590df640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fa154071810 0x7fa15413a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:44764/0 (socket says 172.21.15.172:44764) 2024-06-11T17:18:08.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.971+0000 7fa1590df640 1 -- 172.21.15.172:0/2574015292 learned_addr learned my addr 172.21.15.172:0/2574015292 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-06-11T17:18:08.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.971+0000 7fa1598e0640 1 -- 172.21.15.172:0/2574015292 >> v1:172.21.15.172:6789/0 conn(0x7fa154071810 legacy=0x7fa15413a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:08.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.971+0000 7fa1598e0640 1 -- 172.21.15.172:0/2574015292 >> v1:172.21.15.130:6789/0 conn(0x7fa154071bf0 legacy=0x7fa154140b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:08.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.971+0000 7fa1598e0640 1 -- 172.21.15.172:0/2574015292 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa154072910 con 0x7fa154141240 2024-06-11T17:18:08.972 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.975+0000 7fa1598e0640 1 --2- 172.21.15.172:0/2574015292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa154141240 0x7fa15414c1e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa14c009d90 tx=0x7fa14c01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e14aa4bbd1e349ed server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:08.972 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.975+0000 7fa147fff640 1 -- 172.21.15.172:0/2574015292 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa14c0b2070 con 0x7fa154141240 2024-06-11T17:18:08.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.975+0000 7fa147fff640 1 -- 172.21.15.172:0/2574015292 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa14c0a5920 con 0x7fa154141240 2024-06-11T17:18:08.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.975+0000 7fa147fff640 1 -- 172.21.15.172:0/2574015292 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa14c0a5cf0 con 0x7fa154141240 2024-06-11T17:18:08.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.975+0000 7fa15b343640 1 -- 172.21.15.172:0/2574015292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa154141240 msgr2=0x7fa15414c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:08.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.975+0000 7fa15b343640 1 --2- 172.21.15.172:0/2574015292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa154141240 0x7fa15414c1e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa14c009d90 tx=0x7fa14c01c950 comp rx=0 tx=0).stop 2024-06-11T17:18:08.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.975+0000 7fa15b343640 1 -- 172.21.15.172:0/2574015292 shutdown_connections 2024-06-11T17:18:08.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.975+0000 7fa15b343640 1 --2- 172.21.15.172:0/2574015292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa154141240 0x7fa15414c1e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:08.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.975+0000 7fa15b343640 1 -- 172.21.15.172:0/2574015292 >> 172.21.15.172:0/2574015292 conn(0x7fa1540b69b0 msgr2=0x7fa1540b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:08.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.975+0000 7fa15b343640 1 -- 172.21.15.172:0/2574015292 shutdown_connections 2024-06-11T17:18:08.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.975+0000 7fa15b343640 1 -- 172.21.15.172:0/2574015292 wait complete. 2024-06-11T17:18:08.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.975+0000 7fa15b343640 1 Processor -- start 2024-06-11T17:18:08.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.975+0000 7fa15b343640 1 -- start start 2024-06-11T17:18:08.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.979+0000 7fa15b343640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa154071810 0x7fa15406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:08.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.979+0000 7fa15b343640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa154071bf0 0x7fa1540ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:08.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.979+0000 7fa15b343640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa154141240 0x7fa1541de560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:08.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.979+0000 7fa15b343640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa15414f2d0 con 0x7fa154141240 2024-06-11T17:18:08.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.979+0000 7fa15b343640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa15414f150 con 0x7fa154071810 2024-06-11T17:18:08.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.979+0000 7fa15b343640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa15414f450 con 0x7fa154071bf0 2024-06-11T17:18:08.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.979+0000 7fa1590df640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa154071810 0x7fa15406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:08.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.979+0000 7fa1590df640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa154071810 0x7fa15406de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33776/0 (socket says 172.21.15.172:33776) 2024-06-11T17:18:08.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.979+0000 7fa1590df640 1 -- 172.21.15.172:0/962650803 learned_addr learned my addr 172.21.15.172:0/962650803 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-06-11T17:18:08.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.979+0000 7fa1598e0640 1 --2- 172.21.15.172:0/962650803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa154141240 0x7fa1541de560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:08.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.979+0000 7fa1588de640 1 --2- 172.21.15.172:0/962650803 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa154071bf0 0x7fa1540ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:08.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.979+0000 7fa1590df640 1 -- 172.21.15.172:0/962650803 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa154071bf0 msgr2=0x7fa1540ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:08.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.979+0000 7fa1590df640 1 --2- 172.21.15.172:0/962650803 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa154071bf0 0x7fa1540ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:08.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.979+0000 7fa1590df640 1 -- 172.21.15.172:0/962650803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa154141240 msgr2=0x7fa1541de560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:08.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.979+0000 7fa1590df640 1 --2- 172.21.15.172:0/962650803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa154141240 0x7fa1541de560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:08.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.979+0000 7fa1590df640 1 -- 172.21.15.172:0/962650803 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa154145aa0 con 0x7fa154071810 2024-06-11T17:18:08.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.979+0000 7fa1590df640 1 --2- 172.21.15.172:0/962650803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa154071810 0x7fa15406de50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa14800c480 tx=0x7fa14800c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:08.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.979+0000 7fa145ffb640 1 -- 172.21.15.172:0/962650803 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa148017070 con 0x7fa154071810 2024-06-11T17:18:08.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.979+0000 7fa145ffb640 1 -- 172.21.15.172:0/962650803 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa148005d10 con 0x7fa154071810 2024-06-11T17:18:08.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.979+0000 7fa145ffb640 1 -- 172.21.15.172:0/962650803 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1480072b0 con 0x7fa154071810 2024-06-11T17:18:08.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.979+0000 7fa15b343640 1 -- 172.21.15.172:0/962650803 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa154145d80 con 0x7fa154071810 2024-06-11T17:18:08.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.979+0000 7fa15b343640 1 -- 172.21.15.172:0/962650803 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa15406e500 con 0x7fa154071810 2024-06-11T17:18:08.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.979+0000 7fa145ffb640 1 -- 172.21.15.172:0/962650803 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa14801a070 con 0x7fa154071810 2024-06-11T17:18:08.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.979+0000 7fa145ffb640 1 -- 172.21.15.172:0/962650803 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fa1480127b0 con 0x7fa154071810 2024-06-11T17:18:08.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.979+0000 7fa15b343640 1 -- 172.21.15.172:0/962650803 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa15413a580 con 0x7fa154071810 2024-06-11T17:18:08.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:08.983+0000 7fa145ffb640 1 -- 172.21.15.172:0/962650803 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fa148021070 con 0x7fa154071810 2024-06-11T17:18:08.992 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-06-11T17:18:08.995+0000 7f5588203180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-11T17:18:09.034 INFO:tasks.ceph.mgr.y.smithi130.stderr:2024-06-11T17:18:09.034+0000 7f8618fdb180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-11T17:18:09.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.051+0000 7fa15b343640 1 -- 172.21.15.172:0/962650803 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b96b90b9-e209-41df-9235-5ee65fc63857", "id": 1} v 0) -- 0x7fa15406eb20 con 0x7fa154071810 2024-06-11T17:18:09.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.059+0000 7fa145ffb640 1 -- 172.21.15.172:0/962650803 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b96b90b9-e209-41df-9235-5ee65fc63857", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fa148007620 con 0x7fa154071810 2024-06-11T17:18:09.056 INFO:teuthology.orchestra.run.smithi172.stdout:1 2024-06-11T17:18:09.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.059+0000 7fa15b343640 1 -- 172.21.15.172:0/962650803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa154071810 msgr2=0x7fa15406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:09.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.059+0000 7fa15b343640 1 --2- 172.21.15.172:0/962650803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa154071810 0x7fa15406de50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa14800c480 tx=0x7fa14800c940 comp rx=0 tx=0).stop 2024-06-11T17:18:09.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.059+0000 7fa15b343640 1 -- 172.21.15.172:0/962650803 shutdown_connections 2024-06-11T17:18:09.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.059+0000 7fa15b343640 1 --2- 172.21.15.172:0/962650803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa154141240 0x7fa1541de560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.059+0000 7fa15b343640 1 --2- 172.21.15.172:0/962650803 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa154071bf0 0x7fa1540ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.059+0000 7fa15b343640 1 --2- 172.21.15.172:0/962650803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa154071810 0x7fa15406de50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.059+0000 7fa15b343640 1 -- 172.21.15.172:0/962650803 >> 172.21.15.172:0/962650803 conn(0x7fa1540b69b0 msgr2=0x7fa1540b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:09.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.059+0000 7fa15b343640 1 -- 172.21.15.172:0/962650803 shutdown_connections 2024-06-11T17:18:09.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.059+0000 7fa15b343640 1 -- 172.21.15.172:0/962650803 wait complete. 2024-06-11T17:18:09.072 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 4f935459-1234-4e49-86b9-0a5963e12faf 2 2024-06-11T17:18:09.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.191+0000 7f31bdc0f640 1 Processor -- start 2024-06-11T17:18:09.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.191+0000 7f31bdc0f640 1 -- start start 2024-06-11T17:18:09.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.191+0000 7f31bdc0f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f31b806ffb0 0x7f31b813c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:09.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.191+0000 7f31bdc0f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f31b813c890 0x7f31b813f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:09.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.191+0000 7f31bdc0f640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31b8071f30 con 0x7f31b813f7f0 2024-06-11T17:18:09.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.191+0000 7f31bdc0f640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f31b8071040 con 0x7f31b806ffb0 2024-06-11T17:18:09.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.191+0000 7f31bdc0f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f31b8072210 con 0x7f31b813c890 2024-06-11T17:18:09.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.191+0000 7f31b6ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f31b813c890 0x7f31b813f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:09.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.191+0000 7f31b6ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f31b813c890 0x7f31b813f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33782/0 (socket says 172.21.15.172:33782) 2024-06-11T17:18:09.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.191+0000 7f31b6ffd640 1 -- 172.21.15.172:0/1384600055 learned_addr learned my addr 172.21.15.172:0/1384600055 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-06-11T17:18:09.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.191+0000 7f31b77fe640 1 --2- 172.21.15.172:0/1384600055 >> v2:172.21.15.130:3300/0 conn(0x7f31b806ffb0 0x7f31b813c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:09.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.195+0000 7f31b6ffd640 1 -- 172.21.15.172:0/1384600055 >> v2:172.21.15.130:3300/0 conn(0x7f31b806ffb0 msgr2=0x7f31b813c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:09.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.195+0000 7f31b6ffd640 1 --2- 172.21.15.172:0/1384600055 >> v2:172.21.15.130:3300/0 conn(0x7f31b806ffb0 0x7f31b813c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.195+0000 7f31b6ffd640 1 -- 172.21.15.172:0/1384600055 >> v1:172.21.15.130:6789/0 conn(0x7f31b813f7f0 legacy=0x7f31b8142640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:09.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.195+0000 7f31b6ffd640 1 -- 172.21.15.172:0/1384600055 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b813ccb0 con 0x7f31b813c890 2024-06-11T17:18:09.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.195+0000 7f31b6ffd640 1 --2- 172.21.15.172:0/1384600055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31b813c890 0x7f31b813f2b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f31b8071de0 tx=0x7f31ac01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc52d1add1407b41 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:09.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.195+0000 7f31b67fc640 1 -- 172.21.15.172:0/1384600055 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ac0b0070 con 0x7f31b813c890 2024-06-11T17:18:09.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.195+0000 7f31b67fc640 1 -- 172.21.15.172:0/1384600055 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31ac0ab600 con 0x7f31b813c890 2024-06-11T17:18:09.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.195+0000 7f31b67fc640 1 -- 172.21.15.172:0/1384600055 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ac0ab9d0 con 0x7f31b813c890 2024-06-11T17:18:09.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.195+0000 7f31bdc0f640 1 -- 172.21.15.172:0/1384600055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31b813c890 msgr2=0x7f31b813f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:09.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.195+0000 7f31bdc0f640 1 --2- 172.21.15.172:0/1384600055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31b813c890 0x7f31b813f2b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f31b8071de0 tx=0x7f31ac01c470 comp rx=0 tx=0).stop 2024-06-11T17:18:09.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.195+0000 7f31bdc0f640 1 -- 172.21.15.172:0/1384600055 shutdown_connections 2024-06-11T17:18:09.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.195+0000 7f31bdc0f640 1 --2- 172.21.15.172:0/1384600055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31b813c890 0x7f31b813f2b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.195+0000 7f31bdc0f640 1 --2- 172.21.15.172:0/1384600055 >> v2:172.21.15.130:3300/0 conn(0x7f31b806ffb0 0x7f31b813c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.195+0000 7f31bdc0f640 1 -- 172.21.15.172:0/1384600055 >> 172.21.15.172:0/1384600055 conn(0x7f31b80b4fd0 msgr2=0x7f31b80b53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:09.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.195+0000 7f31bdc0f640 1 -- 172.21.15.172:0/1384600055 shutdown_connections 2024-06-11T17:18:09.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.195+0000 7f31bdc0f640 1 -- 172.21.15.172:0/1384600055 wait complete. 2024-06-11T17:18:09.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.199+0000 7f31bdc0f640 1 Processor -- start 2024-06-11T17:18:09.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.199+0000 7f31bdc0f640 1 -- start start 2024-06-11T17:18:09.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.199+0000 7f31bdc0f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31b806ffb0 0x7f31b812f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:09.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.199+0000 7f31bdc0f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31b813c890 0x7f31b813e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:09.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.199+0000 7f31bdc0f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31b813f7f0 0x7f31b81dee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:09.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.199+0000 7f31bdc0f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f31b81430e0 con 0x7f31b813f7f0 2024-06-11T17:18:09.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.199+0000 7f31bdc0f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f31b8142f60 con 0x7f31b813c890 2024-06-11T17:18:09.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.199+0000 7f31bdc0f640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f31b8143260 con 0x7f31b806ffb0 2024-06-11T17:18:09.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.199+0000 7f31b6ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31b813c890 0x7f31b813e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:09.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.199+0000 7f31b6ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31b813c890 0x7f31b813e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33798/0 (socket says 172.21.15.172:33798) 2024-06-11T17:18:09.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.199+0000 7f31b6ffd640 1 -- 172.21.15.172:0/340000540 learned_addr learned my addr 172.21.15.172:0/340000540 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-06-11T17:18:09.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.199+0000 7f31b77fe640 1 --2- 172.21.15.172:0/340000540 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31b806ffb0 0x7f31b812f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:09.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.199+0000 7f31b7fff640 1 --2- 172.21.15.172:0/340000540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31b813f7f0 0x7f31b81dee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:09.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.199+0000 7f31b6ffd640 1 -- 172.21.15.172:0/340000540 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31b806ffb0 msgr2=0x7f31b812f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:09.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.199+0000 7f31b6ffd640 1 --2- 172.21.15.172:0/340000540 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31b806ffb0 0x7f31b812f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.199+0000 7f31b6ffd640 1 -- 172.21.15.172:0/340000540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31b813f7f0 msgr2=0x7f31b81dee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:09.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.199+0000 7f31b6ffd640 1 --2- 172.21.15.172:0/340000540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31b813f7f0 0x7f31b81dee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.199+0000 7f31b6ffd640 1 -- 172.21.15.172:0/340000540 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b81415e0 con 0x7f31b813c890 2024-06-11T17:18:09.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.199+0000 7f31b7fff640 1 --2- 172.21.15.172:0/340000540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31b813f7f0 0x7f31b81dee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-11T17:18:09.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.199+0000 7f31b6ffd640 1 --2- 172.21.15.172:0/340000540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31b813c890 0x7f31b813e8c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f31ac019080 tx=0x7f31ac019210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:09.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.199+0000 7f319ffff640 1 -- 172.21.15.172:0/340000540 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ac0b9070 con 0x7f31b813c890 2024-06-11T17:18:09.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.199+0000 7f319ffff640 1 -- 172.21.15.172:0/340000540 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31ac0b4400 con 0x7f31b813c890 2024-06-11T17:18:09.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.199+0000 7f31bdc0f640 1 -- 172.21.15.172:0/340000540 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31b8142270 con 0x7f31b813c890 2024-06-11T17:18:09.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.199+0000 7f319ffff640 1 -- 172.21.15.172:0/340000540 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ac0b0040 con 0x7f31b813c890 2024-06-11T17:18:09.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.199+0000 7f31bdc0f640 1 -- 172.21.15.172:0/340000540 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31b813efd0 con 0x7f31b813c890 2024-06-11T17:18:09.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.199+0000 7f319ffff640 1 -- 172.21.15.172:0/340000540 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f31ac0bc070 con 0x7f31b813c890 2024-06-11T17:18:09.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.199+0000 7f319ffff640 1 -- 172.21.15.172:0/340000540 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f31ac0bd7d0 con 0x7f31b813c890 2024-06-11T17:18:09.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.199+0000 7f31bdc0f640 1 -- 172.21.15.172:0/340000540 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31b813c350 con 0x7f31b813c890 2024-06-11T17:18:09.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.203+0000 7f319ffff640 1 -- 172.21.15.172:0/340000540 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f31ac0160f0 con 0x7f31b813c890 2024-06-11T17:18:09.201 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-06-11T17:18:09.203+0000 7f5588203180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-11T17:18:09.268 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.271+0000 7f31bdc0f640 1 -- 172.21.15.172:0/340000540 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4f935459-1234-4e49-86b9-0a5963e12faf", "id": 2} v 0) -- 0x7f31b8142440 con 0x7f31b813c890 2024-06-11T17:18:09.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.275+0000 7f319ffff640 1 -- 172.21.15.172:0/340000540 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4f935459-1234-4e49-86b9-0a5963e12faf", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f31ac0bd3b0 con 0x7f31b813c890 2024-06-11T17:18:09.274 INFO:teuthology.orchestra.run.smithi172.stdout:2 2024-06-11T17:18:09.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.275+0000 7f31bdc0f640 1 -- 172.21.15.172:0/340000540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31b813c890 msgr2=0x7f31b813e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:09.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.275+0000 7f31bdc0f640 1 --2- 172.21.15.172:0/340000540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31b813c890 0x7f31b813e8c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f31ac019080 tx=0x7f31ac019210 comp rx=0 tx=0).stop 2024-06-11T17:18:09.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.279+0000 7f31bdc0f640 1 -- 172.21.15.172:0/340000540 shutdown_connections 2024-06-11T17:18:09.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.279+0000 7f31bdc0f640 1 --2- 172.21.15.172:0/340000540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31b813f7f0 0x7f31b81dee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.279+0000 7f31bdc0f640 1 --2- 172.21.15.172:0/340000540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31b813c890 0x7f31b813e8c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.279+0000 7f31bdc0f640 1 --2- 172.21.15.172:0/340000540 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31b806ffb0 0x7f31b812f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.279+0000 7f31bdc0f640 1 -- 172.21.15.172:0/340000540 >> 172.21.15.172:0/340000540 conn(0x7f31b80b4fd0 msgr2=0x7f31b80b2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:09.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.279+0000 7f31bdc0f640 1 -- 172.21.15.172:0/340000540 shutdown_connections 2024-06-11T17:18:09.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.279+0000 7f31bdc0f640 1 -- 172.21.15.172:0/340000540 wait complete. 2024-06-11T17:18:09.290 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new e232dcd6-4ef9-4a81-a427-bf9efcccd670 3 2024-06-11T17:18:09.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.399+0000 7f1f4acda640 1 Processor -- start 2024-06-11T17:18:09.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.399+0000 7f1f4acda640 1 -- start start 2024-06-11T17:18:09.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.399+0000 7f1f4acda640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1f440b61b0 0x7f1f44140050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:09.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.399+0000 7f1f4acda640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f440afc90 0x7f1f44146120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:09.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.399+0000 7f1f4acda640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f440b0f50 con 0x7f1f44140590 2024-06-11T17:18:09.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.399+0000 7f1f4acda640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f1f440b6590 con 0x7f1f440b61b0 2024-06-11T17:18:09.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.399+0000 7f1f4acda640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f1f440b0ac0 con 0x7f1f440afc90 2024-06-11T17:18:09.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.399+0000 7f1f48a76640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1f440b61b0 0x7f1f44140050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:09.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.399+0000 7f1f48a76640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1f440b61b0 0x7f1f44140050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33814/0 (socket says 172.21.15.172:33814) 2024-06-11T17:18:09.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.399+0000 7f1f48a76640 1 -- 172.21.15.172:0/3242903415 learned_addr learned my addr 172.21.15.172:0/3242903415 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-06-11T17:18:09.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.403+0000 7f1f48a76640 1 -- 172.21.15.172:0/3242903415 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f440afc90 msgr2=0x7f1f44146120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:09.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.403+0000 7f1f3bfff640 1 --2- 172.21.15.172:0/3242903415 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f440afc90 0x7f1f44146120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:09.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.403+0000 7f1f48a76640 1 --2- 172.21.15.172:0/3242903415 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f440afc90 0x7f1f44146120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.403+0000 7f1f48a76640 1 -- 172.21.15.172:0/3242903415 >> v1:172.21.15.130:6789/0 conn(0x7f1f44140590 legacy=0x7f1f44146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:09.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.403+0000 7f1f48a76640 1 -- 172.21.15.172:0/3242903415 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f440b1fd0 con 0x7f1f440b61b0 2024-06-11T17:18:09.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.403+0000 7f1f48a76640 1 --2- 172.21.15.172:0/3242903415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f440b61b0 0x7f1f44140050 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1f40009870 tx=0x7f1f4001c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=654d56195b6b5e61 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:09.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.403+0000 7f1f3b7fe640 1 -- 172.21.15.172:0/3242903415 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f400b1070 con 0x7f1f440b61b0 2024-06-11T17:18:09.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.403+0000 7f1f3b7fe640 1 -- 172.21.15.172:0/3242903415 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f400ac630 con 0x7f1f440b61b0 2024-06-11T17:18:09.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.403+0000 7f1f3b7fe640 1 -- 172.21.15.172:0/3242903415 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f400a8050 con 0x7f1f440b61b0 2024-06-11T17:18:09.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.403+0000 7f1f4acda640 1 -- 172.21.15.172:0/3242903415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f440b61b0 msgr2=0x7f1f44140050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:09.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.403+0000 7f1f4acda640 1 --2- 172.21.15.172:0/3242903415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f440b61b0 0x7f1f44140050 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1f40009870 tx=0x7f1f4001c4b0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.403+0000 7f1f4acda640 1 -- 172.21.15.172:0/3242903415 shutdown_connections 2024-06-11T17:18:09.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.403+0000 7f1f4acda640 1 --2- 172.21.15.172:0/3242903415 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f440afc90 0x7f1f44146120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.403+0000 7f1f4acda640 1 --2- 172.21.15.172:0/3242903415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f440b61b0 0x7f1f44140050 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.403+0000 7f1f4acda640 1 -- 172.21.15.172:0/3242903415 >> 172.21.15.172:0/3242903415 conn(0x7f1f4406d7f0 msgr2=0x7f1f440b5840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:09.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.403+0000 7f1f4acda640 1 -- 172.21.15.172:0/3242903415 shutdown_connections 2024-06-11T17:18:09.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.403+0000 7f1f4acda640 1 -- 172.21.15.172:0/3242903415 wait complete. 2024-06-11T17:18:09.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.407+0000 7f1f4acda640 1 Processor -- start 2024-06-11T17:18:09.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.407+0000 7f1f4acda640 1 -- start start 2024-06-11T17:18:09.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.407+0000 7f1f4acda640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f440b61b0 0x7f1f44070830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:09.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.407+0000 7f1f4acda640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f44140590 0x7f1f44141940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:09.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.407+0000 7f1f4acda640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f44070f00 0x7f1f44141e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:09.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.407+0000 7f1f4acda640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1f44150060 con 0x7f1f44140590 2024-06-11T17:18:09.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.407+0000 7f1f4acda640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1f4414fee0 con 0x7f1f440b61b0 2024-06-11T17:18:09.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.407+0000 7f1f4acda640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f1f441501e0 con 0x7f1f44070f00 2024-06-11T17:18:09.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.407+0000 7f1f48a76640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f440b61b0 0x7f1f44070830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:09.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.407+0000 7f1f48a76640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f440b61b0 0x7f1f44070830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33826/0 (socket says 172.21.15.172:33826) 2024-06-11T17:18:09.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.407+0000 7f1f48a76640 1 -- 172.21.15.172:0/2587323990 learned_addr learned my addr 172.21.15.172:0/2587323990 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-06-11T17:18:09.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.407+0000 7f1f3bfff640 1 --2- 172.21.15.172:0/2587323990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f44140590 0x7f1f44141940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:09.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.407+0000 7f1f49277640 1 --2- 172.21.15.172:0/2587323990 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f44070f00 0x7f1f44141e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:09.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.407+0000 7f1f48a76640 1 -- 172.21.15.172:0/2587323990 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f44070f00 msgr2=0x7f1f44141e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:09.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.407+0000 7f1f48a76640 1 --2- 172.21.15.172:0/2587323990 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f44070f00 0x7f1f44141e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.407+0000 7f1f48a76640 1 -- 172.21.15.172:0/2587323990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f44140590 msgr2=0x7f1f44141940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:09.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.407+0000 7f1f48a76640 1 --2- 172.21.15.172:0/2587323990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f44140590 0x7f1f44141940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.407+0000 7f1f48a76640 1 -- 172.21.15.172:0/2587323990 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f44072950 con 0x7f1f440b61b0 2024-06-11T17:18:09.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.407+0000 7f1f3bfff640 1 --2- 172.21.15.172:0/2587323990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f44140590 0x7f1f44141940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-11T17:18:09.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.407+0000 7f1f49277640 1 --2- 172.21.15.172:0/2587323990 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f44070f00 0x7f1f44141e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-11T17:18:09.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.407+0000 7f1f48a76640 1 --2- 172.21.15.172:0/2587323990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f440b61b0 0x7f1f44070830 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1f400af040 tx=0x7f1f40019250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:09.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.407+0000 7f1f397fa640 1 -- 172.21.15.172:0/2587323990 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f400bc070 con 0x7f1f440b61b0 2024-06-11T17:18:09.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.407+0000 7f1f397fa640 1 -- 172.21.15.172:0/2587323990 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f400b7630 con 0x7f1f440b61b0 2024-06-11T17:18:09.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.407+0000 7f1f4acda640 1 -- 172.21.15.172:0/2587323990 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f44072c30 con 0x7f1f440b61b0 2024-06-11T17:18:09.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.407+0000 7f1f397fa640 1 -- 172.21.15.172:0/2587323990 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f400b1040 con 0x7f1f440b61b0 2024-06-11T17:18:09.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.407+0000 7f1f4acda640 1 -- 172.21.15.172:0/2587323990 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f440718b0 con 0x7f1f440b61b0 2024-06-11T17:18:09.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.407+0000 7f1f397fa640 1 -- 172.21.15.172:0/2587323990 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1f400bf070 con 0x7f1f440b61b0 2024-06-11T17:18:09.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.407+0000 7f1f397fa640 1 -- 172.21.15.172:0/2587323990 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f1f400b6860 con 0x7f1f440b61b0 2024-06-11T17:18:09.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.407+0000 7f1f4acda640 1 -- 172.21.15.172:0/2587323990 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f44140050 con 0x7f1f440b61b0 2024-06-11T17:18:09.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.411+0000 7f1f397fa640 1 -- 172.21.15.172:0/2587323990 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f1f40016130 con 0x7f1f440b61b0 2024-06-11T17:18:09.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.479+0000 7f1f4acda640 1 -- 172.21.15.172:0/2587323990 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e232dcd6-4ef9-4a81-a427-bf9efcccd670", "id": 3} v 0) -- 0x7f1f44076450 con 0x7f1f440b61b0 2024-06-11T17:18:09.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.487+0000 7f1f397fa640 1 -- 172.21.15.172:0/2587323990 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e232dcd6-4ef9-4a81-a427-bf9efcccd670", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f1f400ac5c0 con 0x7f1f440b61b0 2024-06-11T17:18:09.483 INFO:teuthology.orchestra.run.smithi172.stdout:3 2024-06-11T17:18:09.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.487+0000 7f1f4acda640 1 -- 172.21.15.172:0/2587323990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f440b61b0 msgr2=0x7f1f44070830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:09.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.487+0000 7f1f4acda640 1 --2- 172.21.15.172:0/2587323990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f440b61b0 0x7f1f44070830 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1f400af040 tx=0x7f1f40019250 comp rx=0 tx=0).stop 2024-06-11T17:18:09.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.487+0000 7f1f4acda640 1 -- 172.21.15.172:0/2587323990 shutdown_connections 2024-06-11T17:18:09.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.487+0000 7f1f4acda640 1 --2- 172.21.15.172:0/2587323990 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f44070f00 0x7f1f44141e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.487+0000 7f1f4acda640 1 --2- 172.21.15.172:0/2587323990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f44140590 0x7f1f44141940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.487+0000 7f1f4acda640 1 --2- 172.21.15.172:0/2587323990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f440b61b0 0x7f1f44070830 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.487+0000 7f1f4acda640 1 -- 172.21.15.172:0/2587323990 >> 172.21.15.172:0/2587323990 conn(0x7f1f4406d7f0 msgr2=0x7f1f4406c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:09.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.487+0000 7f1f4acda640 1 -- 172.21.15.172:0/2587323990 shutdown_connections 2024-06-11T17:18:09.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.487+0000 7f1f4acda640 1 -- 172.21.15.172:0/2587323990 wait complete. 2024-06-11T17:18:09.499 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 1370f2fe-be19-41e6-8476-a59ad515bd69 4 2024-06-11T17:18:09.581 INFO:tasks.ceph.mgr.y.smithi130.stderr:2024-06-11T17:18:09.582+0000 7f8618fdb180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-11T17:18:09.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.615+0000 7fafd8ec4640 1 Processor -- start 2024-06-11T17:18:09.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.615+0000 7fafd8ec4640 1 -- start start 2024-06-11T17:18:09.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.615+0000 7fafd8ec4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fafd40736b0 0x7fafd413dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:09.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.615+0000 7fafd8ec4640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafd40b1c10 con 0x7fafd40b09d0 2024-06-11T17:18:09.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.615+0000 7fafd8ec4640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafd40b5f50 con 0x7fafd413e2e0 2024-06-11T17:18:09.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.615+0000 7fafd8ec4640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fafd40b6230 con 0x7fafd40736b0 2024-06-11T17:18:09.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.619+0000 7fafd2d9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fafd413e2e0 0x7fafd414b2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:44780/0 (socket says 172.21.15.172:44780) 2024-06-11T17:18:09.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.619+0000 7fafd2d9d640 1 -- 172.21.15.172:0/1666683544 learned_addr learned my addr 172.21.15.172:0/1666683544 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-06-11T17:18:09.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.619+0000 7fafd259c640 1 --2- 172.21.15.172:0/1666683544 >> v2:172.21.15.130:3300/0 conn(0x7fafd40736b0 0x7fafd413dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:09.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.619+0000 7fafd159a640 1 -- 172.21.15.172:0/1666683544 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 251904146 0 0) 0x7fafd40b5f50 con 0x7fafd413e2e0 2024-06-11T17:18:09.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.619+0000 7fafd159a640 1 -- 172.21.15.172:0/1666683544 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafbc003530 con 0x7fafd413e2e0 2024-06-11T17:18:09.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.619+0000 7fafd159a640 1 -- 172.21.15.172:0/1666683544 <== mon.1 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 941967811 0 0) 0x7fafbc003530 con 0x7fafd413e2e0 2024-06-11T17:18:09.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.619+0000 7fafd159a640 1 -- 172.21.15.172:0/1666683544 >> v2:172.21.15.130:3300/0 conn(0x7fafd40736b0 msgr2=0x7fafd413dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:09.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.619+0000 7fafd159a640 1 --2- 172.21.15.172:0/1666683544 >> v2:172.21.15.130:3300/0 conn(0x7fafd40736b0 0x7fafd413dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.619+0000 7fafd159a640 1 -- 172.21.15.172:0/1666683544 >> v1:172.21.15.130:6789/0 conn(0x7fafd40b09d0 legacy=0x7fafd4143f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:09.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.619+0000 7fafd159a640 1 -- 172.21.15.172:0/1666683544 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd40b0710 con 0x7fafd413e2e0 2024-06-11T17:18:09.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.619+0000 7fafd159a640 1 -- 172.21.15.172:0/1666683544 <== mon.1 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3158545239 0 0) 0x7fafcc001a80 con 0x7fafd413e2e0 2024-06-11T17:18:09.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.619+0000 7fafd159a640 1 -- 172.21.15.172:0/1666683544 >> v1:172.21.15.172:6789/0 conn(0x7fafd413e2e0 legacy=0x7fafd414b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:09.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.619+0000 7fafd159a640 1 --2- 172.21.15.172:0/1666683544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafbc003a60 0x7fafbc003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:09.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.619+0000 7fafd159a640 1 --2- 172.21.15.172:0/1666683544 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafbc004810 0x7fafbc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:09.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.619+0000 7fafd159a640 1 --2- 172.21.15.172:0/1666683544 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafbc0052f0 0x7fafbc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:09.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.619+0000 7fafd159a640 1 -- 172.21.15.172:0/1666683544 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fafd40b6230 con 0x7fafbc004810 2024-06-11T17:18:09.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.619+0000 7fafd159a640 1 -- 172.21.15.172:0/1666683544 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fafbc00c1c0 con 0x7fafbc003a60 2024-06-11T17:18:09.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.619+0000 7fafd159a640 1 -- 172.21.15.172:0/1666683544 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fafbc00c3c0 con 0x7fafbc0052f0 2024-06-11T17:18:09.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.619+0000 7fafd259c640 1 --2- 172.21.15.172:0/1666683544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafbc003a60 0x7fafbc003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:09.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.619+0000 7fafd1d9b640 1 --2- 172.21.15.172:0/1666683544 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafbc004810 0x7fafbc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:09.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.619+0000 7fafd259c640 1 -- 172.21.15.172:0/1666683544 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafbc0052f0 msgr2=0x7fafbc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:09.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.619+0000 7fafd2d9d640 1 --2- 172.21.15.172:0/1666683544 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafbc0052f0 0x7fafbc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:09.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.619+0000 7fafd259c640 1 --2- 172.21.15.172:0/1666683544 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafbc0052f0 0x7fafbc00b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.619+0000 7fafd259c640 1 -- 172.21.15.172:0/1666683544 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafbc004810 msgr2=0x7fafbc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:09.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.619+0000 7fafd259c640 1 --2- 172.21.15.172:0/1666683544 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafbc004810 0x7fafbc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.619+0000 7fafd259c640 1 -- 172.21.15.172:0/1666683544 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafbc003530 con 0x7fafbc003a60 2024-06-11T17:18:09.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.619+0000 7fafd2d9d640 1 -- 172.21.15.172:0/1666683544 reap_dead start 2024-06-11T17:18:09.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.619+0000 7fafd1d9b640 1 --2- 172.21.15.172:0/1666683544 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafbc004810 0x7fafbc004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-11T17:18:09.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.619+0000 7fafd259c640 1 --2- 172.21.15.172:0/1666683544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafbc003a60 0x7fafbc003e80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fafc4009ab0 tx=0x7fafc401ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac4b3323c8eab0ae server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:09.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.619+0000 7fafd159a640 1 -- 172.21.15.172:0/1666683544 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc40096b0 con 0x7fafbc003a60 2024-06-11T17:18:09.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.619+0000 7fafd159a640 1 -- 172.21.15.172:0/1666683544 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc40a6500 con 0x7fafbc003a60 2024-06-11T17:18:09.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.619+0000 7fafd159a640 1 -- 172.21.15.172:0/1666683544 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc40a68f0 con 0x7fafbc003a60 2024-06-11T17:18:09.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.623+0000 7fafd8ec4640 1 -- 172.21.15.172:0/1666683544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafbc003a60 msgr2=0x7fafbc003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:09.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.623+0000 7fafd8ec4640 1 --2- 172.21.15.172:0/1666683544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafbc003a60 0x7fafbc003e80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fafc4009ab0 tx=0x7fafc401ca10 comp rx=0 tx=0).stop 2024-06-11T17:18:09.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.623+0000 7fafd8ec4640 1 -- 172.21.15.172:0/1666683544 shutdown_connections 2024-06-11T17:18:09.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.623+0000 7fafd8ec4640 1 --2- 172.21.15.172:0/1666683544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafbc003a60 0x7fafbc003e80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.623+0000 7fafd8ec4640 1 -- 172.21.15.172:0/1666683544 >> 172.21.15.172:0/1666683544 conn(0x7fafd406d7f0 msgr2=0x7fafd40b5840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:09.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.623+0000 7fafd8ec4640 1 -- 172.21.15.172:0/1666683544 shutdown_connections 2024-06-11T17:18:09.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.623+0000 7fafd8ec4640 1 -- 172.21.15.172:0/1666683544 wait complete. 2024-06-11T17:18:09.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.623+0000 7fafd8ec4640 1 Processor -- start 2024-06-11T17:18:09.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.623+0000 7fafd8ec4640 1 -- start start 2024-06-11T17:18:09.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.623+0000 7fafd8ec4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafbc003a60 0x7fafd40ab3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:09.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.623+0000 7fafd8ec4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafd40ac510 0x7fafd40adc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:09.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.623+0000 7fafd8ec4640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafd40ae1a0 0x7fafd41dc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:09.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.623+0000 7fafd8ec4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fafd4144af0 con 0x7fafd40ac510 2024-06-11T17:18:09.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.623+0000 7fafd8ec4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fafd4144970 con 0x7fafbc003a60 2024-06-11T17:18:09.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.623+0000 7fafd8ec4640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fafd406c050 con 0x7fafd40ae1a0 2024-06-11T17:18:09.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.623+0000 7fafd259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafbc003a60 0x7fafd40ab3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:09.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.623+0000 7fafd259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafbc003a60 0x7fafd40ab3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33854/0 (socket says 172.21.15.172:33854) 2024-06-11T17:18:09.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.623+0000 7fafd259c640 1 -- 172.21.15.172:0/2135594908 learned_addr learned my addr 172.21.15.172:0/2135594908 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-06-11T17:18:09.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.623+0000 7fafd2d9d640 1 --2- 172.21.15.172:0/2135594908 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafd40ae1a0 0x7fafd41dc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:09.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.623+0000 7fafd1d9b640 1 --2- 172.21.15.172:0/2135594908 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafd40ac510 0x7fafd40adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:09.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.623+0000 7fafd259c640 1 -- 172.21.15.172:0/2135594908 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafd40ae1a0 msgr2=0x7fafd41dc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:09.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.623+0000 7fafd259c640 1 --2- 172.21.15.172:0/2135594908 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafd40ae1a0 0x7fafd41dc740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.623+0000 7fafd259c640 1 -- 172.21.15.172:0/2135594908 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafd40ac510 msgr2=0x7fafd40adc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:09.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.623+0000 7fafd259c640 1 --2- 172.21.15.172:0/2135594908 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafd40ac510 0x7fafd40adc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.623+0000 7fafd259c640 1 -- 172.21.15.172:0/2135594908 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd40ae5e0 con 0x7fafbc003a60 2024-06-11T17:18:09.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.623+0000 7fafd259c640 1 --2- 172.21.15.172:0/2135594908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafbc003a60 0x7fafd40ab3d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fafc40b0040 tx=0x7fafc40197b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:09.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.623+0000 7fafc2ffd640 1 -- 172.21.15.172:0/2135594908 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc400f080 con 0x7fafbc003a60 2024-06-11T17:18:09.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.623+0000 7fafc2ffd640 1 -- 172.21.15.172:0/2135594908 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc40be070 con 0x7fafbc003a60 2024-06-11T17:18:09.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.623+0000 7fafd8ec4640 1 -- 172.21.15.172:0/2135594908 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd40ad560 con 0x7fafbc003a60 2024-06-11T17:18:09.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.623+0000 7fafc2ffd640 1 -- 172.21.15.172:0/2135594908 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc40a6ac0 con 0x7fafbc003a60 2024-06-11T17:18:09.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.623+0000 7fafd8ec4640 1 -- 172.21.15.172:0/2135594908 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd40abc80 con 0x7fafbc003a60 2024-06-11T17:18:09.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.623+0000 7fafc2ffd640 1 -- 172.21.15.172:0/2135594908 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fafc40a6c60 con 0x7fafbc003a60 2024-06-11T17:18:09.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.623+0000 7fafc2ffd640 1 -- 172.21.15.172:0/2135594908 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fafc40c3970 con 0x7fafbc003a60 2024-06-11T17:18:09.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.623+0000 7fafd8ec4640 1 -- 172.21.15.172:0/2135594908 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafd40ad2e0 con 0x7fafbc003a60 2024-06-11T17:18:09.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.627+0000 7fafc2ffd640 1 -- 172.21.15.172:0/2135594908 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fafd40ad2e0 con 0x7fafbc003a60 2024-06-11T17:18:09.636 INFO:tasks.ceph.mgr.y.smithi130.stderr:2024-06-11T17:18:09.638+0000 7f8618fdb180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-11T17:18:09.688 INFO:tasks.ceph.mgr.y.smithi130.stderr:2024-06-11T17:18:09.690+0000 7f8618fdb180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-11T17:18:09.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.695+0000 7fafd8ec4640 1 -- 172.21.15.172:0/2135594908 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1370f2fe-be19-41e6-8476-a59ad515bd69", "id": 4} v 0) -- 0x7fafd406c3e0 con 0x7fafbc003a60 2024-06-11T17:18:09.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.703+0000 7fafc2ffd640 1 -- 172.21.15.172:0/2135594908 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1370f2fe-be19-41e6-8476-a59ad515bd69", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fafc4016720 con 0x7fafbc003a60 2024-06-11T17:18:09.700 INFO:teuthology.orchestra.run.smithi172.stdout:4 2024-06-11T17:18:09.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.703+0000 7fafd8ec4640 1 -- 172.21.15.172:0/2135594908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafbc003a60 msgr2=0x7fafd40ab3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:09.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.703+0000 7fafd8ec4640 1 --2- 172.21.15.172:0/2135594908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafbc003a60 0x7fafd40ab3d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fafc40b0040 tx=0x7fafc40197b0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.703+0000 7fafd8ec4640 1 -- 172.21.15.172:0/2135594908 shutdown_connections 2024-06-11T17:18:09.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.703+0000 7fafd8ec4640 1 --2- 172.21.15.172:0/2135594908 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafd40ae1a0 0x7fafd41dc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.703+0000 7fafd8ec4640 1 --2- 172.21.15.172:0/2135594908 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafd40ac510 0x7fafd40adc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.703+0000 7fafd8ec4640 1 --2- 172.21.15.172:0/2135594908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafbc003a60 0x7fafd40ab3d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.703+0000 7fafd8ec4640 1 -- 172.21.15.172:0/2135594908 >> 172.21.15.172:0/2135594908 conn(0x7fafd406d7f0 msgr2=0x7fafd4142cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:09.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.703+0000 7fafd8ec4640 1 -- 172.21.15.172:0/2135594908 shutdown_connections 2024-06-11T17:18:09.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.703+0000 7fafd8ec4640 1 -- 172.21.15.172:0/2135594908 wait complete. 2024-06-11T17:18:09.717 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new c0e83219-1ebf-4d46-83b6-3ca844bbcfe0 5 2024-06-11T17:18:09.777 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-06-11T17:18:09.779+0000 7f5588203180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-11T17:18:09.826 INFO:tasks.ceph.mgr.y.smithi130.stderr:2024-06-11T17:18:09.826+0000 7f8618fdb180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-11T17:18:09.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.831+0000 7fa0c301c640 1 Processor -- start 2024-06-11T17:18:09.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.831+0000 7fa0c301c640 1 -- start start 2024-06-11T17:18:09.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.831+0000 7fa0c301c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa0bc06e380 0x7fa0bc06e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:09.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.831+0000 7fa0c301c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0bc0af030 con 0x7fa0bc0b0120 2024-06-11T17:18:09.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.831+0000 7fa0c301c640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0bc0af310 con 0x7fa0bc140070 2024-06-11T17:18:09.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.831+0000 7fa0c301c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fa0bc06ee10 con 0x7fa0bc06e380 2024-06-11T17:18:09.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.831+0000 7fa0bbfff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fa0bc140070 0x7fa0bc0afa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:44796/0 (socket says 172.21.15.172:44796) 2024-06-11T17:18:09.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.831+0000 7fa0bbfff640 1 -- 172.21.15.172:0/3168635779 learned_addr learned my addr 172.21.15.172:0/3168635779 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-06-11T17:18:09.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.831+0000 7fa0c0db8640 1 --2- 172.21.15.172:0/3168635779 >> v2:172.21.15.130:3300/0 conn(0x7fa0bc06e380 0x7fa0bc06e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:09.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.831+0000 7fa0bb7fe640 1 -- 172.21.15.172:0/3168635779 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1628483653 0 0) 0x7fa0bc0af310 con 0x7fa0bc140070 2024-06-11T17:18:09.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.831+0000 7fa0bb7fe640 1 -- 172.21.15.172:0/3168635779 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0a4003530 con 0x7fa0bc140070 2024-06-11T17:18:09.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.835+0000 7fa0bb7fe640 1 -- 172.21.15.172:0/3168635779 <== mon.1 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2258349774 0 0) 0x7fa0a4003530 con 0x7fa0bc140070 2024-06-11T17:18:09.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.835+0000 7fa0bb7fe640 1 -- 172.21.15.172:0/3168635779 >> v2:172.21.15.130:3300/0 conn(0x7fa0bc06e380 msgr2=0x7fa0bc06e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:09.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.835+0000 7fa0bb7fe640 1 --2- 172.21.15.172:0/3168635779 >> v2:172.21.15.130:3300/0 conn(0x7fa0bc06e380 0x7fa0bc06e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.835+0000 7fa0bb7fe640 1 -- 172.21.15.172:0/3168635779 >> v1:172.21.15.130:6789/0 conn(0x7fa0bc0b0120 legacy=0x7fa0bc14d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:09.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.835+0000 7fa0bb7fe640 1 -- 172.21.15.172:0/3168635779 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0bc06d920 con 0x7fa0bc140070 2024-06-11T17:18:09.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.835+0000 7fa0bb7fe640 1 -- 172.21.15.172:0/3168635779 <== mon.1 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3158545239 0 0) 0x7fa0b0001700 con 0x7fa0bc140070 2024-06-11T17:18:09.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.835+0000 7fa0bb7fe640 1 -- 172.21.15.172:0/3168635779 >> v1:172.21.15.172:6789/0 conn(0x7fa0bc140070 legacy=0x7fa0bc0afa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:09.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.835+0000 7fa0bb7fe640 1 --2- 172.21.15.172:0/3168635779 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0a4003a60 0x7fa0a4003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:09.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.835+0000 7fa0bb7fe640 1 --2- 172.21.15.172:0/3168635779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0a4004810 0x7fa0a4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:09.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.835+0000 7fa0bb7fe640 1 --2- 172.21.15.172:0/3168635779 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0a40051d0 0x7fa0a400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:09.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.835+0000 7fa0bb7fe640 1 -- 172.21.15.172:0/3168635779 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa0bc06ee10 con 0x7fa0a4003a60 2024-06-11T17:18:09.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.835+0000 7fa0bb7fe640 1 -- 172.21.15.172:0/3168635779 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a400c170 con 0x7fa0a4004810 2024-06-11T17:18:09.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.835+0000 7fa0bb7fe640 1 -- 172.21.15.172:0/3168635779 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa0a400c370 con 0x7fa0a40051d0 2024-06-11T17:18:09.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.835+0000 7fa0bbfff640 1 --2- 172.21.15.172:0/3168635779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0a4004810 0x7fa0a4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:09.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.835+0000 7fa0c0db8640 1 --2- 172.21.15.172:0/3168635779 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0a4003a60 0x7fa0a4003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:09.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.835+0000 7fa0bbfff640 1 -- 172.21.15.172:0/3168635779 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0a40051d0 msgr2=0x7fa0a400b9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-11T17:18:09.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.835+0000 7fa0bbfff640 1 --2- 172.21.15.172:0/3168635779 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0a40051d0 0x7fa0a400b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.835+0000 7fa0bbfff640 1 -- 172.21.15.172:0/3168635779 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0a4003a60 msgr2=0x7fa0a4003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:09.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.835+0000 7fa0bbfff640 1 --2- 172.21.15.172:0/3168635779 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0a4003a60 0x7fa0a4003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.835+0000 7fa0bbfff640 1 -- 172.21.15.172:0/3168635779 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0a4003530 con 0x7fa0a4004810 2024-06-11T17:18:09.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.835+0000 7fa0c15b9640 1 -- 172.21.15.172:0/3168635779 reap_dead start 2024-06-11T17:18:09.835 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-06-11T17:18:09.835+0000 7f5588203180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-11T17:18:09.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.835+0000 7fa0bbfff640 1 --2- 172.21.15.172:0/3168635779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0a4004810 0x7fa0a4004c90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa0b000c210 tx=0x7fa0b001cba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb0f13c0c97b4c73 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:09.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.835+0000 7fa0bb7fe640 1 -- 172.21.15.172:0/3168635779 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0007d20 con 0x7fa0a4004810 2024-06-11T17:18:09.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.835+0000 7fa0bb7fe640 1 -- 172.21.15.172:0/3168635779 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0b00a9020 con 0x7fa0a4004810 2024-06-11T17:18:09.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.835+0000 7fa0bb7fe640 1 -- 172.21.15.172:0/3168635779 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc074670 con 0x7fa0a4004810 2024-06-11T17:18:09.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.835+0000 7fa0c301c640 1 -- 172.21.15.172:0/3168635779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0a4004810 msgr2=0x7fa0a4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:09.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.835+0000 7fa0c301c640 1 --2- 172.21.15.172:0/3168635779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0a4004810 0x7fa0a4004c90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa0b000c210 tx=0x7fa0b001cba0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.835+0000 7fa0c301c640 1 -- 172.21.15.172:0/3168635779 shutdown_connections 2024-06-11T17:18:09.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.835+0000 7fa0c301c640 1 --2- 172.21.15.172:0/3168635779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0a4004810 0x7fa0a4004c90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.835+0000 7fa0c301c640 1 -- 172.21.15.172:0/3168635779 >> 172.21.15.172:0/3168635779 conn(0x7fa0bc0b69b0 msgr2=0x7fa0bc0b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:09.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.835+0000 7fa0c301c640 1 -- 172.21.15.172:0/3168635779 shutdown_connections 2024-06-11T17:18:09.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.835+0000 7fa0c301c640 1 -- 172.21.15.172:0/3168635779 wait complete. 2024-06-11T17:18:09.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.839+0000 7fa0c301c640 1 Processor -- start 2024-06-11T17:18:09.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.839+0000 7fa0c301c640 1 -- start start 2024-06-11T17:18:09.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.839+0000 7fa0c301c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0a4004810 0x7fa0bc13f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:09.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.839+0000 7fa0c301c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0bc13c120 0x7fa0bc1deba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:09.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.839+0000 7fa0c301c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0bc143400 0x7fa0bc1409b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:09.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.839+0000 7fa0c301c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa0bc0afda0 con 0x7fa0bc143400 2024-06-11T17:18:09.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.839+0000 7fa0c301c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa0bc0afc20 con 0x7fa0a4004810 2024-06-11T17:18:09.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.839+0000 7fa0c301c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa0bc0aff20 con 0x7fa0bc13c120 2024-06-11T17:18:09.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.839+0000 7fa0c0db8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0a4004810 0x7fa0bc13f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:09.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.839+0000 7fa0c0db8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0a4004810 0x7fa0bc13f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33872/0 (socket says 172.21.15.172:33872) 2024-06-11T17:18:09.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.839+0000 7fa0c0db8640 1 -- 172.21.15.172:0/3051075722 learned_addr learned my addr 172.21.15.172:0/3051075722 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-06-11T17:18:09.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.839+0000 7fa0c0db8640 1 -- 172.21.15.172:0/3051075722 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0bc13c120 msgr2=0x7fa0bc1deba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:09.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.839+0000 7fa0c0db8640 1 --2- 172.21.15.172:0/3051075722 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0bc13c120 0x7fa0bc1deba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.839+0000 7fa0c0db8640 1 -- 172.21.15.172:0/3051075722 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0bc143400 msgr2=0x7fa0bc1409b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:09.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.839+0000 7fa0c0db8640 1 --2- 172.21.15.172:0/3051075722 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0bc143400 0x7fa0bc1409b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.839+0000 7fa0c0db8640 1 -- 172.21.15.172:0/3051075722 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0bc142220 con 0x7fa0a4004810 2024-06-11T17:18:09.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.839+0000 7fa0c0db8640 1 --2- 172.21.15.172:0/3051075722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0a4004810 0x7fa0bc13f040 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac011530 tx=0x7fa0ac0119f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:09.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.839+0000 7fa0b97fa640 1 -- 172.21.15.172:0/3051075722 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac015870 con 0x7fa0a4004810 2024-06-11T17:18:09.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.839+0000 7fa0b97fa640 1 -- 172.21.15.172:0/3051075722 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0ac015a10 con 0x7fa0a4004810 2024-06-11T17:18:09.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.839+0000 7fa0b97fa640 1 -- 172.21.15.172:0/3051075722 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac015de0 con 0x7fa0a4004810 2024-06-11T17:18:09.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.839+0000 7fa0c301c640 1 -- 172.21.15.172:0/3051075722 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0bc142500 con 0x7fa0a4004810 2024-06-11T17:18:09.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.839+0000 7fa0c301c640 1 -- 172.21.15.172:0/3051075722 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0bc143880 con 0x7fa0a4004810 2024-06-11T17:18:09.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.839+0000 7fa0b97fa640 1 -- 172.21.15.172:0/3051075722 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa0ac01d400 con 0x7fa0a4004810 2024-06-11T17:18:09.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.839+0000 7fa0b97fa640 1 -- 172.21.15.172:0/3051075722 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fa0ac013d90 con 0x7fa0a4004810 2024-06-11T17:18:09.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.839+0000 7fa0c301c640 1 -- 172.21.15.172:0/3051075722 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0bc146950 con 0x7fa0a4004810 2024-06-11T17:18:09.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.843+0000 7fa0b97fa640 1 -- 172.21.15.172:0/3051075722 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fa0ac019030 con 0x7fa0a4004810 2024-06-11T17:18:09.888 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-06-11T17:18:09.891+0000 7f5588203180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-11T17:18:09.903 INFO:tasks.ceph.mgr.y.smithi130.stderr:2024-06-11T17:18:09.906+0000 7f8618fdb180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-11T17:18:09.904 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.907+0000 7fa0c301c640 1 -- 172.21.15.172:0/3051075722 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c0e83219-1ebf-4d46-83b6-3ca844bbcfe0", "id": 5} v 0) -- 0x7fa0bc144ce0 con 0x7fa0a4004810 2024-06-11T17:18:09.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.911+0000 7fa0b97fa640 1 -- 172.21.15.172:0/3051075722 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c0e83219-1ebf-4d46-83b6-3ca844bbcfe0", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fa0ac013810 con 0x7fa0a4004810 2024-06-11T17:18:09.910 INFO:teuthology.orchestra.run.smithi172.stdout:5 2024-06-11T17:18:09.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.915+0000 7fa0c301c640 1 -- 172.21.15.172:0/3051075722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0a4004810 msgr2=0x7fa0bc13f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:09.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.915+0000 7fa0c301c640 1 --2- 172.21.15.172:0/3051075722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0a4004810 0x7fa0bc13f040 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac011530 tx=0x7fa0ac0119f0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.915+0000 7fa0c301c640 1 -- 172.21.15.172:0/3051075722 shutdown_connections 2024-06-11T17:18:09.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.915+0000 7fa0c301c640 1 --2- 172.21.15.172:0/3051075722 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0bc143400 0x7fa0bc1409b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.915+0000 7fa0c301c640 1 --2- 172.21.15.172:0/3051075722 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0bc13c120 0x7fa0bc1deba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.915+0000 7fa0c301c640 1 --2- 172.21.15.172:0/3051075722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0a4004810 0x7fa0bc13f040 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:09.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.915+0000 7fa0c301c640 1 -- 172.21.15.172:0/3051075722 >> 172.21.15.172:0/3051075722 conn(0x7fa0bc0b69b0 msgr2=0x7fa0bc0b6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:09.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.915+0000 7fa0c301c640 1 -- 172.21.15.172:0/3051075722 shutdown_connections 2024-06-11T17:18:09.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:09.915+0000 7fa0c301c640 1 -- 172.21.15.172:0/3051075722 wait complete. 2024-06-11T17:18:09.927 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 08334a75-d052-4cb8-ae48-5908947f920f 6 2024-06-11T17:18:09.956 INFO:tasks.ceph.mgr.y.smithi130.stderr:2024-06-11T17:18:09.958+0000 7f8618fdb180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-11T17:18:10.034 INFO:tasks.ceph.mgr.y.smithi130.stderr:2024-06-11T17:18:10.034+0000 7f8618fdb180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-11T17:18:10.035 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-06-11T17:18:10.035+0000 7f5588203180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-11T17:18:10.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.039+0000 7f7874a85640 1 Processor -- start 2024-06-11T17:18:10.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.039+0000 7f7874a85640 1 -- start start 2024-06-11T17:18:10.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.039+0000 7f7874a85640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7870141240 0x7f787014c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:10.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.039+0000 7f7874a85640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7870073790 con 0x7f7870071810 2024-06-11T17:18:10.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.039+0000 7f7874a85640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7870073a70 con 0x7f7870071bf0 2024-06-11T17:18:10.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.039+0000 7f7874a85640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f7870073d50 con 0x7f7870141240 2024-06-11T17:18:10.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.039+0000 7f786dd9b640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f7870071bf0 0x7f7870140b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:44804/0 (socket says 172.21.15.172:44804) 2024-06-11T17:18:10.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.039+0000 7f786dd9b640 1 -- 172.21.15.172:0/2930084281 learned_addr learned my addr 172.21.15.172:0/2930084281 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-06-11T17:18:10.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.039+0000 7f786ed9d640 1 --2- 172.21.15.172:0/2930084281 >> v2:172.21.15.130:3300/0 conn(0x7f7870141240 0x7f787014c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:10.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.039+0000 7f786d59a640 1 -- 172.21.15.172:0/2930084281 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3345722684 0 0) 0x7f7870073a70 con 0x7f7870071bf0 2024-06-11T17:18:10.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.039+0000 7f786d59a640 1 -- 172.21.15.172:0/2930084281 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7858003530 con 0x7f7870071bf0 2024-06-11T17:18:10.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.039+0000 7f786d59a640 1 -- 172.21.15.172:0/2930084281 <== mon.1 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1118029052 0 0) 0x7f7858003530 con 0x7f7870071bf0 2024-06-11T17:18:10.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.039+0000 7f786d59a640 1 -- 172.21.15.172:0/2930084281 >> v2:172.21.15.130:3300/0 conn(0x7f7870141240 msgr2=0x7f787014c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:10.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.039+0000 7f786d59a640 1 --2- 172.21.15.172:0/2930084281 >> v2:172.21.15.130:3300/0 conn(0x7f7870141240 0x7f787014c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:10.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.039+0000 7f786d59a640 1 -- 172.21.15.172:0/2930084281 >> v1:172.21.15.130:6789/0 conn(0x7f7870071810 legacy=0x7f787013a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:10.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.039+0000 7f786d59a640 1 -- 172.21.15.172:0/2930084281 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7870072910 con 0x7f7870071bf0 2024-06-11T17:18:10.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.039+0000 7f786d59a640 1 -- 172.21.15.172:0/2930084281 <== mon.1 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3158545239 0 0) 0x7f7864001700 con 0x7f7870071bf0 2024-06-11T17:18:10.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.039+0000 7f786d59a640 1 -- 172.21.15.172:0/2930084281 >> v1:172.21.15.172:6789/0 conn(0x7f7870071bf0 legacy=0x7f7870140b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:10.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.039+0000 7f786d59a640 1 --2- 172.21.15.172:0/2930084281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7858003a60 0x7f7858003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:10.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.039+0000 7f786d59a640 1 --2- 172.21.15.172:0/2930084281 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7858004810 0x7f7858004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:10.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.039+0000 7f786d59a640 1 --2- 172.21.15.172:0/2930084281 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78580051d0 0x7f785800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:10.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.039+0000 7f786d59a640 1 -- 172.21.15.172:0/2930084281 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7870073d50 con 0x7f78580051d0 2024-06-11T17:18:10.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.039+0000 7f786d59a640 1 -- 172.21.15.172:0/2930084281 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f785800c170 con 0x7f7858003a60 2024-06-11T17:18:10.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.039+0000 7f786d59a640 1 -- 172.21.15.172:0/2930084281 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f785800c370 con 0x7f7858004810 2024-06-11T17:18:10.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.039+0000 7f786e59c640 1 --2- 172.21.15.172:0/2930084281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7858003a60 0x7f7858003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:10.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.039+0000 7f786ed9d640 1 --2- 172.21.15.172:0/2930084281 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78580051d0 0x7f785800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:10.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.039+0000 7f786dd9b640 1 --2- 172.21.15.172:0/2930084281 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7858004810 0x7f7858004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:10.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.039+0000 7f786e59c640 1 -- 172.21.15.172:0/2930084281 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7858004810 msgr2=0x7f7858004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:10.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.039+0000 7f786e59c640 1 --2- 172.21.15.172:0/2930084281 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7858004810 0x7f7858004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:10.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.039+0000 7f786e59c640 1 -- 172.21.15.172:0/2930084281 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78580051d0 msgr2=0x7f785800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:10.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.039+0000 7f786e59c640 1 --2- 172.21.15.172:0/2930084281 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78580051d0 0x7f785800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:10.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.039+0000 7f786e59c640 1 -- 172.21.15.172:0/2930084281 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7858003530 con 0x7f7858003a60 2024-06-11T17:18:10.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.039+0000 7f786ed9d640 1 -- 172.21.15.172:0/2930084281 reap_dead start 2024-06-11T17:18:10.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.039+0000 7f786dd9b640 1 --2- 172.21.15.172:0/2930084281 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7858004810 0x7f7858004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-11T17:18:10.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.043+0000 7f786e59c640 1 --2- 172.21.15.172:0/2930084281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7858003a60 0x7f7858003e80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7860001790 tx=0x7f786001c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c946e8d0f7a59e5d server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:10.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.043+0000 7f786d59a640 1 -- 172.21.15.172:0/2930084281 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78600013e0 con 0x7f7858003a60 2024-06-11T17:18:10.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.043+0000 7f786d59a640 1 -- 172.21.15.172:0/2930084281 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78600052d0 con 0x7f7858003a60 2024-06-11T17:18:10.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.043+0000 7f786d59a640 1 -- 172.21.15.172:0/2930084281 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7860003840 con 0x7f7858003a60 2024-06-11T17:18:10.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.043+0000 7f7874a85640 1 -- 172.21.15.172:0/2930084281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7858003a60 msgr2=0x7f7858003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:10.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.043+0000 7f7874a85640 1 --2- 172.21.15.172:0/2930084281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7858003a60 0x7f7858003e80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7860001790 tx=0x7f786001c370 comp rx=0 tx=0).stop 2024-06-11T17:18:10.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.043+0000 7f7874a85640 1 -- 172.21.15.172:0/2930084281 shutdown_connections 2024-06-11T17:18:10.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.043+0000 7f7874a85640 1 --2- 172.21.15.172:0/2930084281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7858003a60 0x7f7858003e80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:10.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.043+0000 7f7874a85640 1 -- 172.21.15.172:0/2930084281 >> 172.21.15.172:0/2930084281 conn(0x7f78700b69b0 msgr2=0x7f78700b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:10.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.043+0000 7f7874a85640 1 -- 172.21.15.172:0/2930084281 shutdown_connections 2024-06-11T17:18:10.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.043+0000 7f7874a85640 1 -- 172.21.15.172:0/2930084281 wait complete. 2024-06-11T17:18:10.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.043+0000 7f7874a85640 1 Processor -- start 2024-06-11T17:18:10.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.043+0000 7f7874a85640 1 -- start start 2024-06-11T17:18:10.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.043+0000 7f7874a85640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7858003a60 0x7f787013d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:10.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.043+0000 7f7874a85640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78701ca250 0x7f78701ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:10.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.043+0000 7f7874a85640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78701cabf0 0x7f78701336a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:10.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.043+0000 7f7874a85640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7870140cb0 con 0x7f78701cabf0 2024-06-11T17:18:10.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.043+0000 7f7874a85640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7870140b30 con 0x7f78701ca250 2024-06-11T17:18:10.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.043+0000 7f7874a85640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f7870140e30 con 0x7f7858003a60 2024-06-11T17:18:10.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.043+0000 7f786dd9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78701ca250 0x7f78701ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:10.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.043+0000 7f786dd9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78701ca250 0x7f78701ca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33894/0 (socket says 172.21.15.172:33894) 2024-06-11T17:18:10.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.043+0000 7f786dd9b640 1 -- 172.21.15.172:0/2011744023 learned_addr learned my addr 172.21.15.172:0/2011744023 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-06-11T17:18:10.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.043+0000 7f786e59c640 1 --2- 172.21.15.172:0/2011744023 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7858003a60 0x7f787013d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:10.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.043+0000 7f786ed9d640 1 --2- 172.21.15.172:0/2011744023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78701cabf0 0x7f78701336a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:10.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.043+0000 7f786dd9b640 1 -- 172.21.15.172:0/2011744023 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7858003a60 msgr2=0x7f787013d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:10.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.043+0000 7f786dd9b640 1 --2- 172.21.15.172:0/2011744023 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7858003a60 0x7f787013d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:10.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.043+0000 7f786dd9b640 1 -- 172.21.15.172:0/2011744023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78701cabf0 msgr2=0x7f78701336a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:10.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.043+0000 7f786dd9b640 1 --2- 172.21.15.172:0/2011744023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78701cabf0 0x7f78701336a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:10.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.043+0000 7f786dd9b640 1 -- 172.21.15.172:0/2011744023 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f787013c2e0 con 0x7f78701ca250 2024-06-11T17:18:10.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.047+0000 7f786dd9b640 1 --2- 172.21.15.172:0/2011744023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78701ca250 0x7f78701ca6b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7864005fd0 tx=0x7f786400ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:10.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.047+0000 7f785effd640 1 -- 172.21.15.172:0/2011744023 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786400c6c0 con 0x7f78701ca250 2024-06-11T17:18:10.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.047+0000 7f785effd640 1 -- 172.21.15.172:0/2011744023 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7864018070 con 0x7f78701ca250 2024-06-11T17:18:10.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.047+0000 7f785effd640 1 -- 172.21.15.172:0/2011744023 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786400ca80 con 0x7f78701ca250 2024-06-11T17:18:10.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.047+0000 7f7874a85640 1 -- 172.21.15.172:0/2011744023 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f787013c5c0 con 0x7f78701ca250 2024-06-11T17:18:10.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.047+0000 7f7874a85640 1 -- 172.21.15.172:0/2011744023 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78701ccb30 con 0x7f78701ca250 2024-06-11T17:18:10.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.047+0000 7f785effd640 1 -- 172.21.15.172:0/2011744023 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f786400cc20 con 0x7f78701ca250 2024-06-11T17:18:10.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.047+0000 7f785effd640 1 -- 172.21.15.172:0/2011744023 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f7864013a10 con 0x7f78701ca250 2024-06-11T17:18:10.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.047+0000 7f7874a85640 1 -- 172.21.15.172:0/2011744023 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78700008e0 con 0x7f78701ca250 2024-06-11T17:18:10.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.047+0000 7f785effd640 1 -- 172.21.15.172:0/2011744023 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f7864013cf0 con 0x7f78701ca250 2024-06-11T17:18:10.086 INFO:tasks.ceph.mgr.y.smithi130.stderr:2024-06-11T17:18:10.086+0000 7f8618fdb180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-11T17:18:10.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.111+0000 7f7874a85640 1 -- 172.21.15.172:0/2011744023 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd new", "uuid": "08334a75-d052-4cb8-ae48-5908947f920f", "id": 6} v 0) -- 0x7f787013d560 con 0x7f78701ca250 2024-06-11T17:18:10.115 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-06-11T17:18:10.119+0000 7f5588203180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-11T17:18:10.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.119+0000 7f785effd640 1 -- 172.21.15.172:0/2011744023 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "08334a75-d052-4cb8-ae48-5908947f920f", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f7864013420 con 0x7f78701ca250 2024-06-11T17:18:10.116 INFO:teuthology.orchestra.run.smithi172.stdout:6 2024-06-11T17:18:10.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.119+0000 7f7874a85640 1 -- 172.21.15.172:0/2011744023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78701ca250 msgr2=0x7f78701ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:10.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.119+0000 7f7874a85640 1 --2- 172.21.15.172:0/2011744023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78701ca250 0x7f78701ca6b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7864005fd0 tx=0x7f786400ec10 comp rx=0 tx=0).stop 2024-06-11T17:18:10.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.119+0000 7f7874a85640 1 -- 172.21.15.172:0/2011744023 shutdown_connections 2024-06-11T17:18:10.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.119+0000 7f7874a85640 1 --2- 172.21.15.172:0/2011744023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78701cabf0 0x7f78701336a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:10.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.119+0000 7f7874a85640 1 --2- 172.21.15.172:0/2011744023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78701ca250 0x7f78701ca6b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:10.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.119+0000 7f7874a85640 1 --2- 172.21.15.172:0/2011744023 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7858003a60 0x7f787013d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:10.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.119+0000 7f7874a85640 1 -- 172.21.15.172:0/2011744023 >> 172.21.15.172:0/2011744023 conn(0x7f78700b69b0 msgr2=0x7f78700b5cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:10.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.119+0000 7f7874a85640 1 -- 172.21.15.172:0/2011744023 shutdown_connections 2024-06-11T17:18:10.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.119+0000 7f7874a85640 1 -- 172.21.15.172:0/2011744023 wait complete. 2024-06-11T17:18:10.132 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new ec87f14f-b324-47e4-9740-fb304bf3d963 7 2024-06-11T17:18:10.172 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-06-11T17:18:10.175+0000 7f5588203180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-11T17:18:10.238 INFO:tasks.ceph.mgr.y.smithi130.stderr:2024-06-11T17:18:10.238+0000 7f8618fdb180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-11T17:18:10.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.251+0000 7f3390110640 1 Processor -- start 2024-06-11T17:18:10.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.251+0000 7f3390110640 1 -- start start 2024-06-11T17:18:10.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.255+0000 7f3390110640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3388071810 0x7f3388071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:10.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.255+0000 7f3390110640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f338813a9a0 0x7f3388141240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:10.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.255+0000 7f3390110640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3388141780 con 0x7f338813a580 2024-06-11T17:18:10.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.255+0000 7f3390110640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f3388073790 con 0x7f3388071810 2024-06-11T17:18:10.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.255+0000 7f3390110640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f3388073a70 con 0x7f338813a9a0 2024-06-11T17:18:10.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.255+0000 7f338deac640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3388071810 0x7f3388071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:10.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.255+0000 7f338e6ad640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f338813a9a0 0x7f3388141240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:10.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.255+0000 7f338d6ab640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f338813a580 0x7f3388140b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.172:44436/0 (socket says 172.21.15.172:44436) 2024-06-11T17:18:10.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.255+0000 7f338d6ab640 1 -- 172.21.15.172:0/1837875754 learned_addr learned my addr 172.21.15.172:0/1837875754 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-06-11T17:18:10.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.255+0000 7f338deac640 1 -- 172.21.15.172:0/1837875754 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f338813a9a0 msgr2=0x7f3388141240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:10.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.255+0000 7f338deac640 1 --2- 172.21.15.172:0/1837875754 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f338813a9a0 0x7f3388141240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:10.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.255+0000 7f338deac640 1 -- 172.21.15.172:0/1837875754 >> v1:172.21.15.130:6789/0 conn(0x7f338813a580 legacy=0x7f3388140b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:10.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.255+0000 7f338deac640 1 -- 172.21.15.172:0/1837875754 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3388073d50 con 0x7f3388071810 2024-06-11T17:18:10.253 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-06-11T17:18:10.255+0000 7f5588203180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-11T17:18:10.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.259+0000 7f338deac640 1 --2- 172.21.15.172:0/1837875754 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3388071810 0x7f3388071bf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3384009d90 tx=0x7f338401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8466dae1e7befd09 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:10.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.259+0000 7f338ceaa640 1 -- 172.21.15.172:0/1837875754 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33840b2070 con 0x7f3388071810 2024-06-11T17:18:10.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.259+0000 7f338ceaa640 1 -- 172.21.15.172:0/1837875754 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33840a5920 con 0x7f3388071810 2024-06-11T17:18:10.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.259+0000 7f338ceaa640 1 -- 172.21.15.172:0/1837875754 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33840a5cf0 con 0x7f3388071810 2024-06-11T17:18:10.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.259+0000 7f3390110640 1 -- 172.21.15.172:0/1837875754 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3388071810 msgr2=0x7f3388071bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:10.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.259+0000 7f3390110640 1 --2- 172.21.15.172:0/1837875754 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3388071810 0x7f3388071bf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3384009d90 tx=0x7f338401c950 comp rx=0 tx=0).stop 2024-06-11T17:18:10.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.259+0000 7f3390110640 1 -- 172.21.15.172:0/1837875754 shutdown_connections 2024-06-11T17:18:10.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.259+0000 7f3390110640 1 --2- 172.21.15.172:0/1837875754 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f338813a9a0 0x7f3388141240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:10.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.259+0000 7f3390110640 1 --2- 172.21.15.172:0/1837875754 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3388071810 0x7f3388071bf0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:10.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.259+0000 7f3390110640 1 -- 172.21.15.172:0/1837875754 >> 172.21.15.172:0/1837875754 conn(0x7f33880b69b0 msgr2=0x7f33880b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:10.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.259+0000 7f3390110640 1 -- 172.21.15.172:0/1837875754 shutdown_connections 2024-06-11T17:18:10.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.259+0000 7f3390110640 1 -- 172.21.15.172:0/1837875754 wait complete. 2024-06-11T17:18:10.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.259+0000 7f3390110640 1 Processor -- start 2024-06-11T17:18:10.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.259+0000 7f3390110640 1 -- start start 2024-06-11T17:18:10.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.259+0000 7f3390110640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3388071810 0x7f33881451f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:10.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.259+0000 7f3390110640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f338813a580 0x7f3388137930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:10.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.259+0000 7f3390110640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f338813a9a0 0x7f3388137e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:10.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.259+0000 7f3390110640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f338814dd80 con 0x7f3388071810 2024-06-11T17:18:10.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.259+0000 7f3390110640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f338814dc00 con 0x7f338813a580 2024-06-11T17:18:10.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.259+0000 7f3390110640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f338814df00 con 0x7f338813a9a0 2024-06-11T17:18:10.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.259+0000 7f338d6ab640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f338813a580 0x7f3388137930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:10.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.259+0000 7f338d6ab640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f338813a580 0x7f3388137930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33902/0 (socket says 172.21.15.172:33902) 2024-06-11T17:18:10.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.259+0000 7f338d6ab640 1 -- 172.21.15.172:0/4126453815 learned_addr learned my addr 172.21.15.172:0/4126453815 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-06-11T17:18:10.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.259+0000 7f338e6ad640 1 --2- 172.21.15.172:0/4126453815 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f338813a9a0 0x7f3388137e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:10.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.259+0000 7f338deac640 1 --2- 172.21.15.172:0/4126453815 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3388071810 0x7f33881451f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:10.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.259+0000 7f338d6ab640 1 -- 172.21.15.172:0/4126453815 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f338813a9a0 msgr2=0x7f3388137e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:10.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.259+0000 7f338d6ab640 1 --2- 172.21.15.172:0/4126453815 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f338813a9a0 0x7f3388137e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:10.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.259+0000 7f338d6ab640 1 -- 172.21.15.172:0/4126453815 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3388071810 msgr2=0x7f33881451f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:10.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.259+0000 7f338d6ab640 1 --2- 172.21.15.172:0/4126453815 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3388071810 0x7f33881451f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:10.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.259+0000 7f338d6ab640 1 -- 172.21.15.172:0/4126453815 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3388146ee0 con 0x7f338813a580 2024-06-11T17:18:10.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.259+0000 7f338e6ad640 1 --2- 172.21.15.172:0/4126453815 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f338813a9a0 0x7f3388137e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-11T17:18:10.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.263+0000 7f338d6ab640 1 --2- 172.21.15.172:0/4126453815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f338813a580 0x7f3388137930 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f337800c4e0 tx=0x7f337800c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:10.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.263+0000 7f337e7fc640 1 -- 172.21.15.172:0/4126453815 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3378017070 con 0x7f338813a580 2024-06-11T17:18:10.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.263+0000 7f337e7fc640 1 -- 172.21.15.172:0/4126453815 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3378005d10 con 0x7f338813a580 2024-06-11T17:18:10.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.263+0000 7f3390110640 1 -- 172.21.15.172:0/4126453815 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33881383b0 con 0x7f338813a580 2024-06-11T17:18:10.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.263+0000 7f337e7fc640 1 -- 172.21.15.172:0/4126453815 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33780072b0 con 0x7f338813a580 2024-06-11T17:18:10.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.263+0000 7f3390110640 1 -- 172.21.15.172:0/4126453815 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3388149e80 con 0x7f338813a580 2024-06-11T17:18:10.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.263+0000 7f3390110640 1 -- 172.21.15.172:0/4126453815 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3388071bf0 con 0x7f338813a580 2024-06-11T17:18:10.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.263+0000 7f337e7fc640 1 -- 172.21.15.172:0/4126453815 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f337801a070 con 0x7f338813a580 2024-06-11T17:18:10.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.263+0000 7f337e7fc640 1 -- 172.21.15.172:0/4126453815 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f3378012a60 con 0x7f338813a580 2024-06-11T17:18:10.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.263+0000 7f337e7fc640 1 -- 172.21.15.172:0/4126453815 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f3378021070 con 0x7f338813a580 2024-06-11T17:18:10.300 INFO:tasks.ceph.mgr.y.smithi130.stderr:2024-06-11T17:18:10.302+0000 7f8618fdb180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-11T17:18:10.307 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-06-11T17:18:10.311+0000 7f5588203180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-11T17:18:10.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.331+0000 7f3390110640 1 -- 172.21.15.172:0/4126453815 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ec87f14f-b324-47e4-9740-fb304bf3d963", "id": 7} v 0) -- 0x7f33880b6030 con 0x7f338813a580 2024-06-11T17:18:10.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.335+0000 7f337e7fc640 1 -- 172.21.15.172:0/4126453815 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ec87f14f-b324-47e4-9740-fb304bf3d963", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f3378007450 con 0x7f338813a580 2024-06-11T17:18:10.335 INFO:teuthology.orchestra.run.smithi172.stdout:7 2024-06-11T17:18:10.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.339+0000 7f3390110640 1 -- 172.21.15.172:0/4126453815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f338813a580 msgr2=0x7f3388137930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:10.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.339+0000 7f3390110640 1 --2- 172.21.15.172:0/4126453815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f338813a580 0x7f3388137930 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f337800c4e0 tx=0x7f337800c9a0 comp rx=0 tx=0).stop 2024-06-11T17:18:10.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.339+0000 7f3390110640 1 -- 172.21.15.172:0/4126453815 shutdown_connections 2024-06-11T17:18:10.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.339+0000 7f3390110640 1 --2- 172.21.15.172:0/4126453815 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f338813a9a0 0x7f3388137e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:10.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.339+0000 7f3390110640 1 --2- 172.21.15.172:0/4126453815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f338813a580 0x7f3388137930 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:10.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.339+0000 7f3390110640 1 --2- 172.21.15.172:0/4126453815 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3388071810 0x7f33881451f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:10.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.339+0000 7f3390110640 1 -- 172.21.15.172:0/4126453815 >> 172.21.15.172:0/4126453815 conn(0x7f33880b69b0 msgr2=0x7f338814a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:10.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.339+0000 7f3390110640 1 -- 172.21.15.172:0/4126453815 shutdown_connections 2024-06-11T17:18:10.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-06-11T17:18:10.339+0000 7f3390110640 1 -- 172.21.15.172:0/4126453815 wait complete. 2024-06-11T17:18:10.352 INFO:tasks.ceph.osd.0:Restarting daemon 2024-06-11T17:18:10.352 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-06-11T17:18:10.355 INFO:tasks.ceph.osd.0:Started 2024-06-11T17:18:10.355 INFO:tasks.ceph.osd.1:Restarting daemon 2024-06-11T17:18:10.355 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-06-11T17:18:10.358 INFO:tasks.ceph.osd.1:Started 2024-06-11T17:18:10.358 INFO:tasks.ceph.osd.2:Restarting daemon 2024-06-11T17:18:10.358 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-06-11T17:18:10.361 INFO:tasks.ceph.osd.2:Started 2024-06-11T17:18:10.362 INFO:tasks.ceph.osd.3:Restarting daemon 2024-06-11T17:18:10.362 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-06-11T17:18:10.364 INFO:tasks.ceph.osd.3:Started 2024-06-11T17:18:10.365 INFO:tasks.ceph.osd.4:Restarting daemon 2024-06-11T17:18:10.365 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-06-11T17:18:10.397 INFO:tasks.ceph.osd.4:Started 2024-06-11T17:18:10.397 INFO:tasks.ceph.osd.5:Restarting daemon 2024-06-11T17:18:10.397 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-06-11T17:18:10.400 INFO:tasks.ceph.osd.5:Started 2024-06-11T17:18:10.401 INFO:tasks.ceph.osd.6:Restarting daemon 2024-06-11T17:18:10.401 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-06-11T17:18:10.404 INFO:tasks.ceph.osd.6:Started 2024-06-11T17:18:10.404 INFO:tasks.ceph.osd.7:Restarting daemon 2024-06-11T17:18:10.404 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-06-11T17:18:10.407 INFO:tasks.ceph.osd.7:Started 2024-06-11T17:18:10.407 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-11T17:18:10.482 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-06-11T17:18:10.483+0000 7f5588203180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-11T17:18:10.522 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.522+0000 7f096d4d5640 1 Processor -- start 2024-06-11T17:18:10.523 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.522+0000 7f096d4d5640 1 -- start start 2024-06-11T17:18:10.524 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.526+0000 7f096d4d5640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f096806c2b0 0x7f096813df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:10.524 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.526+0000 7f096d4d5640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0968144810 0x7f096813e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:10.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.526+0000 7f096d4d5640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f096806cef0 con 0x7f09680b1250 2024-06-11T17:18:10.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.526+0000 7f096d4d5640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f096806c690 con 0x7f096806c2b0 2024-06-11T17:18:10.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.526+0000 7f096d4d5640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f09680b1770 con 0x7f0968144810 2024-06-11T17:18:10.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.526+0000 7f09677fe640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0968144810 0x7f096813e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:10.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.526+0000 7f0966ffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f096806c2b0 0x7f096813df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:10.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.526+0000 7f09677fe640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0968144810 0x7f096813e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:35460/0 (socket says 172.21.15.130:35460) 2024-06-11T17:18:10.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.526+0000 7f09677fe640 1 -- 172.21.15.130:0/18022548 learned_addr learned my addr 172.21.15.130:0/18022548 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:10.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.526+0000 7f09677fe640 1 -- 172.21.15.130:0/18022548 >> v2:172.21.15.130:3300/0 conn(0x7f096806c2b0 msgr2=0x7f096813df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:10.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.526+0000 7f09677fe640 1 --2- 172.21.15.130:0/18022548 >> v2:172.21.15.130:3300/0 conn(0x7f096806c2b0 0x7f096813df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:10.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.526+0000 7f09677fe640 1 -- 172.21.15.130:0/18022548 >> v1:172.21.15.172:6789/0 conn(0x7f09680b1250 legacy=0x7f0968144100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:10.526 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.526+0000 7f09677fe640 1 -- 172.21.15.130:0/18022548 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09680b19c0 con 0x7f0968144810 2024-06-11T17:18:10.526 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.526+0000 7f0966ffd640 1 --2- 172.21.15.130:0/18022548 >> v2:172.21.15.130:3300/0 conn(0x7f096806c2b0 0x7f096813df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:18:10.527 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.526+0000 7f09677fe640 1 --2- 172.21.15.130:0/18022548 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0968144810 0x7f096813e4b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0960009870 tx=0x7f096001c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fdefa2530769638 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:10.527 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.526+0000 7f0965ffb640 1 -- 172.21.15.130:0/18022548 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09600b0070 con 0x7f0968144810 2024-06-11T17:18:10.528 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.526+0000 7f0965ffb640 1 -- 172.21.15.130:0/18022548 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09600ab600 con 0x7f0968144810 2024-06-11T17:18:10.528 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.526+0000 7f0965ffb640 1 -- 172.21.15.130:0/18022548 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09600ab9d0 con 0x7f0968144810 2024-06-11T17:18:10.528 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.526+0000 7f096d4d5640 1 -- 172.21.15.130:0/18022548 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0968144810 msgr2=0x7f096813e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:10.528 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.526+0000 7f096d4d5640 1 --2- 172.21.15.130:0/18022548 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0968144810 0x7f096813e4b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0960009870 tx=0x7f096001c540 comp rx=0 tx=0).stop 2024-06-11T17:18:10.528 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.526+0000 7f096d4d5640 1 -- 172.21.15.130:0/18022548 shutdown_connections 2024-06-11T17:18:10.528 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.526+0000 7f096d4d5640 1 --2- 172.21.15.130:0/18022548 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0968144810 0x7f096813e4b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:10.528 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.526+0000 7f096d4d5640 1 --2- 172.21.15.130:0/18022548 >> v2:172.21.15.130:3300/0 conn(0x7f096806c2b0 0x7f096813df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:10.528 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.526+0000 7f096d4d5640 1 -- 172.21.15.130:0/18022548 >> 172.21.15.130:0/18022548 conn(0x7f096806d160 msgr2=0x7f096806d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:10.529 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.526+0000 7f096d4d5640 1 -- 172.21.15.130:0/18022548 shutdown_connections 2024-06-11T17:18:10.529 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.526+0000 7f096d4d5640 1 -- 172.21.15.130:0/18022548 wait complete. 2024-06-11T17:18:10.529 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.530+0000 7f096d4d5640 1 Processor -- start 2024-06-11T17:18:10.529 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.530+0000 7f096d4d5640 1 -- start start 2024-06-11T17:18:10.531 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.530+0000 7f096d4d5640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f096806c2b0 0x7f0968143580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:10.532 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.530+0000 7f096d4d5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09680b1250 0x7f09681db930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:10.532 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.530+0000 7f096d4d5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0968144810 0x7f09681dbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:10.532 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.530+0000 7f096d4d5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f096814dfe0 con 0x7f0968144810 2024-06-11T17:18:10.532 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.530+0000 7f096d4d5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f096814de60 con 0x7f09680b1250 2024-06-11T17:18:10.532 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.530+0000 7f096d4d5640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f096814e160 con 0x7f096806c2b0 2024-06-11T17:18:10.532 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.530+0000 7f0966ffd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f096806c2b0 0x7f0968143580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:10.532 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.530+0000 7f0966ffd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f096806c2b0 0x7f0968143580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:35476/0 (socket says 172.21.15.130:35476) 2024-06-11T17:18:10.532 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.530+0000 7f0966ffd640 1 -- 172.21.15.130:0/3505256450 learned_addr learned my addr 172.21.15.130:0/3505256450 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:10.532 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.530+0000 7f09677fe640 1 --2- 172.21.15.130:0/3505256450 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0968144810 0x7f09681dbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:10.532 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.530+0000 7f09667fc640 1 --2- 172.21.15.130:0/3505256450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09680b1250 0x7f09681db930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:10.533 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.530+0000 7f09677fe640 1 -- 172.21.15.130:0/3505256450 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f096806c2b0 msgr2=0x7f0968143580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:10.533 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.530+0000 7f09677fe640 1 --2- 172.21.15.130:0/3505256450 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f096806c2b0 0x7f0968143580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:10.533 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.530+0000 7f09677fe640 1 -- 172.21.15.130:0/3505256450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09680b1250 msgr2=0x7f09681db930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:10.533 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.530+0000 7f09677fe640 1 --2- 172.21.15.130:0/3505256450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09680b1250 0x7f09681db930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:10.533 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.530+0000 7f09677fe640 1 -- 172.21.15.130:0/3505256450 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f096813f860 con 0x7f0968144810 2024-06-11T17:18:10.533 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.530+0000 7f0966ffd640 1 --2- 172.21.15.130:0/3505256450 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f096806c2b0 0x7f0968143580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:18:10.533 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.530+0000 7f09677fe640 1 --2- 172.21.15.130:0/3505256450 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0968144810 0x7f09681dbe70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f09680b18f0 tx=0x7f09600192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:10.533 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.530+0000 7f095f7fe640 1 -- 172.21.15.130:0/3505256450 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09600b0040 con 0x7f0968144810 2024-06-11T17:18:10.533 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.530+0000 7f095f7fe640 1 -- 172.21.15.130:0/3505256450 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09600b9070 con 0x7f0968144810 2024-06-11T17:18:10.533 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.530+0000 7f096d4d5640 1 -- 172.21.15.130:0/3505256450 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f096813fb40 con 0x7f0968144810 2024-06-11T17:18:10.533 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.530+0000 7f095f7fe640 1 -- 172.21.15.130:0/3505256450 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09600b4670 con 0x7f0968144810 2024-06-11T17:18:10.534 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.530+0000 7f096d4d5640 1 -- 172.21.15.130:0/3505256450 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f096814a2a0 con 0x7f0968144810 2024-06-11T17:18:10.534 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.530+0000 7f095f7fe640 1 -- 172.21.15.130:0/3505256450 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f09600b4ba0 con 0x7f0968144810 2024-06-11T17:18:10.534 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.530+0000 7f095f7fe640 1 -- 172.21.15.130:0/3505256450 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f09600aaa70 con 0x7f0968144810 2024-06-11T17:18:10.534 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.530+0000 7f096d4d5640 1 -- 172.21.15.130:0/3505256450 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09681db600 con 0x7f0968144810 2024-06-11T17:18:10.534 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.534+0000 7f095f7fe640 1 -- 172.21.15.130:0/3505256450 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f0960016130 con 0x7f0968144810 2024-06-11T17:18:10.549 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-06-11T17:18:10.551+0000 7f5588203180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-11T17:18:10.588 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.590+0000 7f096d4d5640 1 -- 172.21.15.130:0/3505256450 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0968144100 con 0x7f0968144810 2024-06-11T17:18:10.589 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.590+0000 7f095f7fe640 1 -- 172.21.15.130:0/3505256450 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f09600aad10 con 0x7f0968144810 2024-06-11T17:18:10.590 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:18:10.590 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":10,"fsid":"fae1d0b0-28f2-4ebc-8a2f-59aed9de5555","created":"2024-06-11T17:18:08.122125+0000","modified":"2024-06-11T17:18:10.336508+0000","last_up_change":"0.000000","last_in_change":"2024-06-11T17:18:10.336508+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0bb385e4-fde4-44a5-a9ca-491e3a80dd65","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b96b90b9-e209-41df-9235-5ee65fc63857","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4f935459-1234-4e49-86b9-0a5963e12faf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e232dcd6-4ef9-4a81-a427-bf9efcccd670","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1370f2fe-be19-41e6-8476-a59ad515bd69","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c0e83219-1ebf-4d46-83b6-3ca844bbcfe0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"08334a75-d052-4cb8-ae48-5908947f920f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ec87f14f-b324-47e4-9740-fb304bf3d963","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-11T17:18:10.591 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.590+0000 7f096d4d5640 1 -- 172.21.15.130:0/3505256450 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0968144810 msgr2=0x7f09681dbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:10.591 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.590+0000 7f096d4d5640 1 --2- 172.21.15.130:0/3505256450 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0968144810 0x7f09681dbe70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f09680b18f0 tx=0x7f09600192e0 comp rx=0 tx=0).stop 2024-06-11T17:18:10.591 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.590+0000 7f096d4d5640 1 -- 172.21.15.130:0/3505256450 shutdown_connections 2024-06-11T17:18:10.591 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.590+0000 7f096d4d5640 1 --2- 172.21.15.130:0/3505256450 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0968144810 0x7f09681dbe70 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:10.592 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.590+0000 7f096d4d5640 1 --2- 172.21.15.130:0/3505256450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09680b1250 0x7f09681db930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:10.592 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.590+0000 7f096d4d5640 1 --2- 172.21.15.130:0/3505256450 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f096806c2b0 0x7f0968143580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:10.592 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.590+0000 7f096d4d5640 1 -- 172.21.15.130:0/3505256450 >> 172.21.15.130:0/3505256450 conn(0x7f096806d160 msgr2=0x7f096806d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:10.592 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.590+0000 7f096d4d5640 1 -- 172.21.15.130:0/3505256450 shutdown_connections 2024-06-11T17:18:10.592 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:10.590+0000 7f096d4d5640 1 -- 172.21.15.130:0/3505256450 wait complete. 2024-06-11T17:18:10.607 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-06-11T17:18:10.607 INFO:tasks.ceph:Waiting for OSDs to come up 2024-06-11T17:18:10.935 INFO:tasks.ceph.mgr.y.smithi130.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-06-11T17:18:10.935 INFO:tasks.ceph.mgr.y.smithi130.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-06-11T17:18:10.935 INFO:tasks.ceph.mgr.y.smithi130.stderr: from numpy import show_config as show_numpy_config 2024-06-11T17:18:10.980 INFO:tasks.ceph.osd.0.smithi130.stderr:2024-06-11T17:18:10.982+0000 7fca0190d7c0 -1 Falling back to public interface 2024-06-11T17:18:10.981 INFO:tasks.ceph.osd.1.smithi130.stderr:2024-06-11T17:18:10.982+0000 7f17d0e6e7c0 -1 Falling back to public interface 2024-06-11T17:18:10.981 INFO:tasks.ceph.mgr.y.smithi130.stderr:2024-06-11T17:18:10.982+0000 7f8618fdb180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-11T17:18:11.003 INFO:tasks.ceph.osd.2.smithi130.stderr:2024-06-11T17:18:11.006+0000 7f2d52b117c0 -1 Falling back to public interface 2024-06-11T17:18:11.004 INFO:tasks.ceph.osd.3.smithi130.stderr:2024-06-11T17:18:11.006+0000 7fd5743f37c0 -1 Falling back to public interface 2024-06-11T17:18:11.028 INFO:tasks.ceph.osd.7.smithi172.stderr:2024-06-11T17:18:11.031+0000 7f62f4f7b7c0 -1 Falling back to public interface 2024-06-11T17:18:11.028 INFO:tasks.ceph.osd.5.smithi172.stderr:2024-06-11T17:18:11.031+0000 7f58755747c0 -1 Falling back to public interface 2024-06-11T17:18:11.028 INFO:tasks.ceph.osd.6.smithi172.stderr:2024-06-11T17:18:11.031+0000 7f69463647c0 -1 Falling back to public interface 2024-06-11T17:18:11.043 INFO:tasks.ceph.osd.4.smithi172.stderr:2024-06-11T17:18:11.047+0000 7efcad67e7c0 -1 Falling back to public interface 2024-06-11T17:18:11.136 INFO:tasks.ceph.mgr.y.smithi130.stderr:2024-06-11T17:18:11.138+0000 7f8618fdb180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-11T17:18:11.277 INFO:tasks.ceph.mgr.x.smithi172.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-06-11T17:18:11.277 INFO:tasks.ceph.mgr.x.smithi172.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-06-11T17:18:11.277 INFO:tasks.ceph.mgr.x.smithi172.stderr: from numpy import show_config as show_numpy_config 2024-06-11T17:18:11.294 INFO:tasks.ceph.mgr.y.smithi130.stderr:2024-06-11T17:18:11.294+0000 7f8618fdb180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-11T17:18:11.357 INFO:tasks.ceph.mgr.y.smithi130.stderr:2024-06-11T17:18:11.358+0000 7f8618fdb180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-11T17:18:11.358 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-06-11T17:18:11.359+0000 7f5588203180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-11T17:18:11.414 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-06-11T17:18:11.493 INFO:tasks.ceph.mgr.y.smithi130.stderr:2024-06-11T17:18:11.494+0000 7f8618fdb180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-11T17:18:11.510 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-06-11T17:18:11.511+0000 7f5588203180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-11T17:18:11.526 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.526+0000 7f9cbfd42640 1 Processor -- start 2024-06-11T17:18:11.527 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.526+0000 7f9cbfd42640 1 -- start start 2024-06-11T17:18:11.528 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.530+0000 7f9cbfd42640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9cb806bff0 0x7f9cb81412e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:11.528 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.530+0000 7f9cbfd42640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cb806c440 con 0x7f9cb80b0780 2024-06-11T17:18:11.528 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.530+0000 7f9cbfd42640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cb806c6c0 con 0x7f9cb813e2f0 2024-06-11T17:18:11.528 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.530+0000 7f9cbfd42640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9cb80b0b60 con 0x7f9cb806bff0 2024-06-11T17:18:11.528 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.530+0000 7f9cbe2df640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9cb806bff0 0x7f9cb81412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:11.528 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.530+0000 7f9cbdade640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f9cb80b0780 0x7f9cb813dbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:35780/0 (socket says 172.21.15.130:35780) 2024-06-11T17:18:11.528 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.530+0000 7f9cbdade640 1 -- 172.21.15.130:0/2941436954 learned_addr learned my addr 172.21.15.130:0/2941436954 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-06-11T17:18:11.528 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.530+0000 7f9cbcadc640 1 -- 172.21.15.130:0/2941436954 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3433209973 0 0) 0x7f9cb4001120 con 0x7f9cb80b0780 2024-06-11T17:18:11.529 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.530+0000 7f9cbe2df640 1 -- 172.21.15.130:0/2941436954 >> v1:172.21.15.172:6789/0 conn(0x7f9cb813e2f0 legacy=0x7f9cb8140bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:11.529 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.530+0000 7f9cbe2df640 1 -- 172.21.15.130:0/2941436954 >> v1:172.21.15.130:6789/0 conn(0x7f9cb80b0780 legacy=0x7f9cb813dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:11.529 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.530+0000 7f9cbe2df640 1 -- 172.21.15.130:0/2941436954 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb8141820 con 0x7f9cb806bff0 2024-06-11T17:18:11.530 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.530+0000 7f9cbe2df640 1 --2- 172.21.15.130:0/2941436954 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9cb806bff0 0x7f9cb81412e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009dc0 tx=0x7f9cb001c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6018622c414a8f88 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:11.530 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.530+0000 7f9cbcadc640 1 -- 172.21.15.130:0/2941436954 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb00b2070 con 0x7f9cb806bff0 2024-06-11T17:18:11.530 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.530+0000 7f9cbcadc640 1 -- 172.21.15.130:0/2941436954 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cb00a5870 con 0x7f9cb806bff0 2024-06-11T17:18:11.530 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.530+0000 7f9cbcadc640 1 -- 172.21.15.130:0/2941436954 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb00a5c40 con 0x7f9cb806bff0 2024-06-11T17:18:11.531 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cbfd42640 1 -- 172.21.15.130:0/2941436954 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9cb806bff0 msgr2=0x7f9cb81412e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:11.531 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cbfd42640 1 --2- 172.21.15.130:0/2941436954 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9cb806bff0 0x7f9cb81412e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009dc0 tx=0x7f9cb001c8e0 comp rx=0 tx=0).stop 2024-06-11T17:18:11.531 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cbfd42640 1 -- 172.21.15.130:0/2941436954 shutdown_connections 2024-06-11T17:18:11.532 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cbfd42640 1 --2- 172.21.15.130:0/2941436954 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9cb806bff0 0x7f9cb81412e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:11.532 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cbfd42640 1 -- 172.21.15.130:0/2941436954 >> 172.21.15.130:0/2941436954 conn(0x7f9cb80b27f0 msgr2=0x7f9cb80b2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:11.532 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cbfd42640 1 -- 172.21.15.130:0/2941436954 shutdown_connections 2024-06-11T17:18:11.532 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cbfd42640 1 -- 172.21.15.130:0/2941436954 wait complete. 2024-06-11T17:18:11.535 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cbfd42640 1 Processor -- start 2024-06-11T17:18:11.535 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cbfd42640 1 -- start start 2024-06-11T17:18:11.535 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cbfd42640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cb806bff0 0x7f9cb80aea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:11.535 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cbfd42640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9cb80b0780 0x7f9cb8145320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:11.535 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cbfd42640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cb813e2f0 0x7f9cb8145860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:11.535 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cbfd42640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb814ef20 con 0x7f9cb806bff0 2024-06-11T17:18:11.535 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cbfd42640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb814eda0 con 0x7f9cb813e2f0 2024-06-11T17:18:11.535 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cbfd42640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9cb814f0a0 con 0x7f9cb80b0780 2024-06-11T17:18:11.535 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cbdade640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cb806bff0 0x7f9cb80aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:11.536 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cbd2dd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9cb80b0780 0x7f9cb8145320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:11.536 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cbd2dd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9cb80b0780 0x7f9cb8145320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:35492/0 (socket says 172.21.15.130:35492) 2024-06-11T17:18:11.536 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cbd2dd640 1 -- 172.21.15.130:0/2215963878 learned_addr learned my addr 172.21.15.130:0/2215963878 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:11.536 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cbdade640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cb806bff0 0x7f9cb80aea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:55188/0 (socket says 172.21.15.130:55188) 2024-06-11T17:18:11.536 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cbe2df640 1 --2- 172.21.15.130:0/2215963878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cb813e2f0 0x7f9cb8145860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:11.536 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cbd2dd640 1 -- 172.21.15.130:0/2215963878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cb813e2f0 msgr2=0x7f9cb8145860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:11.536 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cbd2dd640 1 --2- 172.21.15.130:0/2215963878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cb813e2f0 0x7f9cb8145860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:11.536 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cbd2dd640 1 -- 172.21.15.130:0/2215963878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cb806bff0 msgr2=0x7f9cb80aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:11.536 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cbd2dd640 1 --2- 172.21.15.130:0/2215963878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cb806bff0 0x7f9cb80aea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:11.536 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cbd2dd640 1 -- 172.21.15.130:0/2215963878 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb8146a90 con 0x7f9cb80b0780 2024-06-11T17:18:11.536 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cbdade640 1 --2- 172.21.15.130:0/2215963878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cb806bff0 0x7f9cb80aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:18:11.536 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cbd2dd640 1 --2- 172.21.15.130:0/2215963878 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9cb80b0780 0x7f9cb8145320 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9ca800b440 tx=0x7f9ca800b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:11.536 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cae7fc640 1 -- 172.21.15.130:0/2215963878 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca8015020 con 0x7f9cb80b0780 2024-06-11T17:18:11.537 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cae7fc640 1 -- 172.21.15.130:0/2215963878 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ca8011890 con 0x7f9cb80b0780 2024-06-11T17:18:11.537 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cbfd42640 1 -- 172.21.15.130:0/2215963878 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cb806fd00 con 0x7f9cb80b0780 2024-06-11T17:18:11.537 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cae7fc640 1 -- 172.21.15.130:0/2215963878 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca8011c80 con 0x7f9cb80b0780 2024-06-11T17:18:11.537 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cbfd42640 1 -- 172.21.15.130:0/2215963878 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cb80713d0 con 0x7f9cb80b0780 2024-06-11T17:18:11.537 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cae7fc640 1 -- 172.21.15.130:0/2215963878 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9ca8018020 con 0x7f9cb80b0780 2024-06-11T17:18:11.537 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cae7fc640 1 -- 172.21.15.130:0/2215963878 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f9ca801aad0 con 0x7f9cb80b0780 2024-06-11T17:18:11.537 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.534+0000 7f9cbfd42640 1 -- 172.21.15.130:0/2215963878 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cb813dbe0 con 0x7f9cb80b0780 2024-06-11T17:18:11.548 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.550+0000 7f9cae7fc640 1 -- 172.21.15.130:0/2215963878 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f9ca801f030 con 0x7f9cb80b0780 2024-06-11T17:18:11.606 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.606+0000 7f9cbfd42640 1 -- 172.21.15.130:0/2215963878 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9cb8069250 con 0x7f9cb80b0780 2024-06-11T17:18:11.607 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.606+0000 7f9cae7fc640 1 -- 172.21.15.130:0/2215963878 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f9ca800d040 con 0x7f9cb80b0780 2024-06-11T17:18:11.607 INFO:teuthology.misc.health.smithi130.stdout: 2024-06-11T17:18:11.607 INFO:teuthology.misc.health.smithi130.stdout:{"epoch":10,"fsid":"fae1d0b0-28f2-4ebc-8a2f-59aed9de5555","created":"2024-06-11T17:18:08.122125+0000","modified":"2024-06-11T17:18:10.336508+0000","last_up_change":"0.000000","last_in_change":"2024-06-11T17:18:10.336508+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0bb385e4-fde4-44a5-a9ca-491e3a80dd65","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b96b90b9-e209-41df-9235-5ee65fc63857","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4f935459-1234-4e49-86b9-0a5963e12faf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e232dcd6-4ef9-4a81-a427-bf9efcccd670","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1370f2fe-be19-41e6-8476-a59ad515bd69","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c0e83219-1ebf-4d46-83b6-3ca844bbcfe0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"08334a75-d052-4cb8-ae48-5908947f920f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ec87f14f-b324-47e4-9740-fb304bf3d963","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-11T17:18:11.608 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.610+0000 7f9cbfd42640 1 -- 172.21.15.130:0/2215963878 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9cb80b0780 msgr2=0x7f9cb8145320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:11.608 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.610+0000 7f9cbfd42640 1 --2- 172.21.15.130:0/2215963878 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9cb80b0780 0x7f9cb8145320 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9ca800b440 tx=0x7f9ca800b900 comp rx=0 tx=0).stop 2024-06-11T17:18:11.608 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.610+0000 7f9cbfd42640 1 -- 172.21.15.130:0/2215963878 shutdown_connections 2024-06-11T17:18:11.608 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.610+0000 7f9cbfd42640 1 --2- 172.21.15.130:0/2215963878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cb813e2f0 0x7f9cb8145860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:11.608 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.610+0000 7f9cbfd42640 1 --2- 172.21.15.130:0/2215963878 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9cb80b0780 0x7f9cb8145320 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:11.608 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.610+0000 7f9cbfd42640 1 --2- 172.21.15.130:0/2215963878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cb806bff0 0x7f9cb80aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:11.608 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.610+0000 7f9cbfd42640 1 -- 172.21.15.130:0/2215963878 >> 172.21.15.130:0/2215963878 conn(0x7f9cb80b27f0 msgr2=0x7f9cb813b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:11.609 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.610+0000 7f9cbfd42640 1 -- 172.21.15.130:0/2215963878 shutdown_connections 2024-06-11T17:18:11.609 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:11.610+0000 7f9cbfd42640 1 -- 172.21.15.130:0/2215963878 wait complete. 2024-06-11T17:18:11.622 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-06-11T17:18:11.681 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-06-11T17:18:11.683+0000 7f5588203180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-11T17:18:11.751 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-06-11T17:18:11.755+0000 7f5588203180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-11T17:18:11.889 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-06-11T17:18:11.891+0000 7f5588203180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-11T17:18:12.101 INFO:tasks.ceph.mgr.y.smithi130.stderr:2024-06-11T17:18:12.102+0000 7f8618fdb180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-11T17:18:12.177 INFO:tasks.ceph.mgr.y.smithi130.stderr:2024-06-11T17:18:12.178+0000 7f8618fdb180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-11T17:18:12.358 INFO:tasks.ceph.mgr.y.smithi130.stderr:2024-06-11T17:18:12.358+0000 7f8618fdb180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-11T17:18:12.430 INFO:tasks.ceph.mgr.y.smithi130.stderr:2024-06-11T17:18:12.430+0000 7f8618fdb180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-11T17:18:12.521 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-06-11T17:18:12.523+0000 7f5588203180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-11T17:18:12.597 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-06-11T17:18:12.599+0000 7f5588203180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-11T17:18:12.717 INFO:tasks.ceph.mgr.y.smithi130.stderr:2024-06-11T17:18:12.718+0000 7f8618fdb180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-11T17:18:12.779 INFO:tasks.ceph.mgr.y.smithi130.stderr:2024-06-11T17:18:12.778+0000 7f8618fdb180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-11T17:18:12.779 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-06-11T17:18:12.779+0000 7f5588203180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-11T17:18:12.856 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-06-11T17:18:12.859+0000 7f5588203180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-11T17:18:13.151 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-06-11T17:18:13.155+0000 7f5588203180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-11T17:18:13.214 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-06-11T17:18:13.215+0000 7f5588203180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-11T17:18:13.815 INFO:tasks.ceph.mgr.y.smithi130.stderr:2024-06-11T17:18:13.818+0000 7f85bf320640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-06-11T17:18:13.821 INFO:tasks.ceph.mgr.y.smithi130.stderr:2024-06-11T17:18:13.822+0000 7f85bf320640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-06-11T17:18:14.796 INFO:tasks.ceph.osd.0.smithi130.stderr:2024-06-11T17:18:14.798+0000 7fca0190d7c0 -1 osd.0 0 log_to_monitors true 2024-06-11T17:18:14.818 INFO:tasks.ceph.osd.4.smithi172.stderr:2024-06-11T17:18:14.819+0000 7efcad67e7c0 -1 osd.4 0 log_to_monitors true 2024-06-11T17:18:14.843 INFO:tasks.ceph.osd.7.smithi172.stderr:2024-06-11T17:18:14.847+0000 7f62f4f7b7c0 -1 osd.7 0 log_to_monitors true 2024-06-11T17:18:14.889 INFO:tasks.ceph.osd.6.smithi172.stderr:2024-06-11T17:18:14.891+0000 7f69463647c0 -1 osd.6 0 log_to_monitors true 2024-06-11T17:18:14.896 INFO:tasks.ceph.osd.5.smithi172.stderr:2024-06-11T17:18:14.899+0000 7f58755747c0 -1 osd.5 0 log_to_monitors true 2024-06-11T17:18:14.917 INFO:tasks.ceph.osd.1.smithi130.stderr:2024-06-11T17:18:14.918+0000 7f17d0e6e7c0 -1 osd.1 0 log_to_monitors true 2024-06-11T17:18:14.920 INFO:tasks.ceph.osd.2.smithi130.stderr:2024-06-11T17:18:14.922+0000 7f2d52b117c0 -1 osd.2 0 log_to_monitors true 2024-06-11T17:18:14.931 INFO:tasks.ceph.osd.3.smithi130.stderr:2024-06-11T17:18:14.934+0000 7fd5743f37c0 -1 osd.3 0 log_to_monitors true 2024-06-11T17:18:16.199 INFO:tasks.ceph.osd.3.smithi130.stderr:2024-06-11T17:18:16.202+0000 7fd57039c640 -1 osd.3 0 waiting for initial osdmap 2024-06-11T17:18:16.209 INFO:tasks.ceph.osd.6.smithi172.stderr:2024-06-11T17:18:16.211+0000 7f694230d640 -1 osd.6 0 waiting for initial osdmap 2024-06-11T17:18:16.212 INFO:tasks.ceph.osd.1.smithi130.stderr:2024-06-11T17:18:16.214+0000 7f17cce17640 -1 osd.1 0 waiting for initial osdmap 2024-06-11T17:18:16.217 INFO:tasks.ceph.osd.1.smithi130.stderr:2024-06-11T17:18:16.218+0000 7f17c8c52640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-11T17:18:16.218 INFO:tasks.ceph.osd.3.smithi130.stderr:2024-06-11T17:18:16.218+0000 7fd56c1d7640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-11T17:18:16.251 INFO:tasks.ceph.osd.6.smithi172.stderr:2024-06-11T17:18:16.255+0000 7f693e148640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-11T17:18:17.523 INFO:tasks.ceph.osd.0.smithi130.stderr:2024-06-11T17:18:17.526+0000 7fc9fd8b6640 -1 osd.0 0 waiting for initial osdmap 2024-06-11T17:18:17.530 INFO:tasks.ceph.osd.0.smithi130.stderr:2024-06-11T17:18:17.530+0000 7fc9f56e9640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-11T17:18:17.541 INFO:tasks.ceph.osd.2.smithi130.stderr:2024-06-11T17:18:17.542+0000 7f2d4eaba640 -1 osd.2 0 waiting for initial osdmap 2024-06-11T17:18:17.545 INFO:tasks.ceph.osd.2.smithi130.stderr:2024-06-11T17:18:17.546+0000 7f2d468ed640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-11T17:18:17.971 INFO:tasks.ceph.osd.5.smithi172.stderr:2024-06-11T17:18:17.975+0000 7f587151d640 -1 osd.5 0 waiting for initial osdmap 2024-06-11T17:18:17.974 INFO:tasks.ceph.osd.7.smithi172.stderr:2024-06-11T17:18:17.975+0000 7f62f0f24640 -1 osd.7 0 waiting for initial osdmap 2024-06-11T17:18:17.977 INFO:tasks.ceph.osd.5.smithi172.stderr:2024-06-11T17:18:17.979+0000 7f5869350640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-11T17:18:17.981 INFO:tasks.ceph.osd.7.smithi172.stderr:2024-06-11T17:18:17.983+0000 7f62e8d57640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-11T17:18:17.982 INFO:tasks.ceph.osd.4.smithi172.stderr:2024-06-11T17:18:17.983+0000 7efca9627640 -1 osd.4 0 waiting for initial osdmap 2024-06-11T17:18:17.988 INFO:tasks.ceph.osd.4.smithi172.stderr:2024-06-11T17:18:17.991+0000 7efca145a640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-11T17:18:18.429 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-06-11T17:18:18.552 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.554+0000 7f70e8db7640 1 Processor -- start 2024-06-11T17:18:18.553 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.554+0000 7f70e8db7640 1 -- start start 2024-06-11T17:18:18.554 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.554+0000 7f70e8db7640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f70e40ae000 0x7f70e40ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:18.554 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.554+0000 7f70e8db7640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f70e41410b0 0x7f70e4141520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:18.554 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.554+0000 7f70e8db7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70e413dc90 0x7f70e413e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:18.555 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.554+0000 7f70e8db7640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f70e40ae3e0 con 0x7f70e40ae000 2024-06-11T17:18:18.555 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.554+0000 7f70e8db7640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f70e4140c20 con 0x7f70e41410b0 2024-06-11T17:18:18.555 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.554+0000 7f70e8db7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f70e406f1b0 con 0x7f70e413dc90 2024-06-11T17:18:18.555 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.554+0000 7f70e259c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f70e40ae000 0x7f70e40ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:18.555 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.554+0000 7f70e2d9d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70e413dc90 0x7f70e413e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:18.555 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.554+0000 7f70e259c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f70e40ae000 0x7f70e40ae9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38244/0 (socket says 172.21.15.130:38244) 2024-06-11T17:18:18.555 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.554+0000 7f70e259c640 1 -- 172.21.15.130:0/1990800725 learned_addr learned my addr 172.21.15.130:0/1990800725 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:18.555 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.554+0000 7f70e259c640 1 -- 172.21.15.130:0/1990800725 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70e413dc90 msgr2=0x7f70e413e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:18.555 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.554+0000 7f70e259c640 1 --2- 172.21.15.130:0/1990800725 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70e413dc90 0x7f70e413e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:18.555 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.554+0000 7f70e259c640 1 -- 172.21.15.130:0/1990800725 >> v2:172.21.15.172:3300/0 conn(0x7f70e41410b0 msgr2=0x7f70e4141520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:18.555 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.554+0000 7f70e259c640 1 --2- 172.21.15.130:0/1990800725 >> v2:172.21.15.172:3300/0 conn(0x7f70e41410b0 0x7f70e4141520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:18.555 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.554+0000 7f70e259c640 1 -- 172.21.15.130:0/1990800725 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e4141a60 con 0x7f70e40ae000 2024-06-11T17:18:18.555 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.554+0000 7f70e2d9d640 1 --2- 172.21.15.130:0/1990800725 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70e413dc90 0x7f70e413e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:18:18.557 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.558+0000 7f70e259c640 1 --2- 172.21.15.130:0/1990800725 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70e40ae000 0x7f70e40ae9a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f70e406e780 tx=0x7f70d401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab7cd1f4719cd42 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:18.557 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.558+0000 7f70e159a640 1 -- 172.21.15.130:0/1990800725 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d40aa5f0 con 0x7f70e40ae000 2024-06-11T17:18:18.557 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.558+0000 7f70e159a640 1 -- 172.21.15.130:0/1990800725 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d40af070 con 0x7f70e40ae000 2024-06-11T17:18:18.557 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.558+0000 7f70e159a640 1 -- 172.21.15.130:0/1990800725 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d40aa9b0 con 0x7f70e40ae000 2024-06-11T17:18:18.558 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.558+0000 7f70e8db7640 1 -- 172.21.15.130:0/1990800725 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70e40ae000 msgr2=0x7f70e40ae9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:18.558 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.558+0000 7f70e8db7640 1 --2- 172.21.15.130:0/1990800725 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70e40ae000 0x7f70e40ae9a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f70e406e780 tx=0x7f70d401c4d0 comp rx=0 tx=0).stop 2024-06-11T17:18:18.558 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.558+0000 7f70e8db7640 1 -- 172.21.15.130:0/1990800725 shutdown_connections 2024-06-11T17:18:18.558 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.558+0000 7f70e8db7640 1 --2- 172.21.15.130:0/1990800725 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70e413dc90 0x7f70e413e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:18.558 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.558+0000 7f70e8db7640 1 --2- 172.21.15.130:0/1990800725 >> v2:172.21.15.172:3300/0 conn(0x7f70e41410b0 0x7f70e4141520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:18.559 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.558+0000 7f70e8db7640 1 --2- 172.21.15.130:0/1990800725 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70e40ae000 0x7f70e40ae9a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:18.559 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.558+0000 7f70e8db7640 1 -- 172.21.15.130:0/1990800725 >> 172.21.15.130:0/1990800725 conn(0x7f70e40b1190 msgr2=0x7f70e40b15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:18.559 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.558+0000 7f70e8db7640 1 -- 172.21.15.130:0/1990800725 shutdown_connections 2024-06-11T17:18:18.559 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.558+0000 7f70e8db7640 1 -- 172.21.15.130:0/1990800725 wait complete. 2024-06-11T17:18:18.561 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.562+0000 7f70e8db7640 1 Processor -- start 2024-06-11T17:18:18.561 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.562+0000 7f70e8db7640 1 -- start start 2024-06-11T17:18:18.562 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.562+0000 7f70e8db7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70e40ae000 0x7f70e4073650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:18.562 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.562+0000 7f70e8db7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70e413dc90 0x7f70e41d8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:18.562 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.562+0000 7f70e8db7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70e41410b0 0x7f70e41d91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:18.562 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.562+0000 7f70e8db7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f70e40af090 con 0x7f70e41410b0 2024-06-11T17:18:18.562 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.562+0000 7f70e8db7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f70e4144870 con 0x7f70e40ae000 2024-06-11T17:18:18.562 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.562+0000 7f70e8db7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f70e4146d80 con 0x7f70e413dc90 2024-06-11T17:18:18.562 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.562+0000 7f70e2d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70e41410b0 0x7f70e41d91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:18.562 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.562+0000 7f70e1d9b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70e413dc90 0x7f70e41d8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:18.562 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.562+0000 7f70e2d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70e41410b0 0x7f70e41d91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38252/0 (socket says 172.21.15.130:38252) 2024-06-11T17:18:18.562 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.562+0000 7f70e2d9d640 1 -- 172.21.15.130:0/3663819296 learned_addr learned my addr 172.21.15.130:0/3663819296 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:18.563 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.562+0000 7f70e259c640 1 --2- 172.21.15.130:0/3663819296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70e40ae000 0x7f70e4073650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:18.563 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.562+0000 7f70e2d9d640 1 -- 172.21.15.130:0/3663819296 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70e413dc90 msgr2=0x7f70e41d8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:18.563 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.562+0000 7f70e2d9d640 1 --2- 172.21.15.130:0/3663819296 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70e413dc90 0x7f70e41d8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:18.563 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.562+0000 7f70e2d9d640 1 -- 172.21.15.130:0/3663819296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70e40ae000 msgr2=0x7f70e4073650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:18.563 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.562+0000 7f70e2d9d640 1 --2- 172.21.15.130:0/3663819296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70e40ae000 0x7f70e4073650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:18.563 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.562+0000 7f70e2d9d640 1 -- 172.21.15.130:0/3663819296 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e41d9710 con 0x7f70e41410b0 2024-06-11T17:18:18.563 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.562+0000 7f70e2d9d640 1 --2- 172.21.15.130:0/3663819296 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70e41410b0 0x7f70e41d91d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f70dc00efc0 tx=0x7f70dc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:18.563 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.562+0000 7f70d2ffd640 1 -- 172.21.15.130:0/3663819296 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70dc018030 con 0x7f70e41410b0 2024-06-11T17:18:18.563 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.562+0000 7f70d2ffd640 1 -- 172.21.15.130:0/3663819296 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70dc00cd30 con 0x7f70e41410b0 2024-06-11T17:18:18.563 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.562+0000 7f70e8db7640 1 -- 172.21.15.130:0/3663819296 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70e4073bf0 con 0x7f70e41410b0 2024-06-11T17:18:18.563 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.562+0000 7f70d2ffd640 1 -- 172.21.15.130:0/3663819296 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70dc003bc0 con 0x7f70e41410b0 2024-06-11T17:18:18.563 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.562+0000 7f70e8db7640 1 -- 172.21.15.130:0/3663819296 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70e4145830 con 0x7f70e41410b0 2024-06-11T17:18:18.564 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.562+0000 7f70e8db7640 1 -- 172.21.15.130:0/3663819296 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70e4144cd0 con 0x7f70e41410b0 2024-06-11T17:18:18.564 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.562+0000 7f70d2ffd640 1 -- 172.21.15.130:0/3663819296 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 4) ==== 94213+0+0 (secure 0 0 0) 0x7f70dc01b070 con 0x7f70e41410b0 2024-06-11T17:18:18.565 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.562+0000 7f70d2ffd640 1 --2- 172.21.15.130:0/3663819296 >> v2:172.21.15.130:6816/3863300924 conn(0x7f70c4070cd0 0x7f70c4073190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:18.565 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.562+0000 7f70d2ffd640 1 -- 172.21.15.130:0/3663819296 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3351+0+0 (secure 0 0 0) 0x7f70dc090f00 con 0x7f70e41410b0 2024-06-11T17:18:18.565 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.562+0000 7f70e259c640 1 --2- 172.21.15.130:0/3663819296 >> v2:172.21.15.130:6816/3863300924 conn(0x7f70c4070cd0 0x7f70c4073190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:18.565 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.566+0000 7f70e259c640 1 --2- 172.21.15.130:0/3663819296 >> v2:172.21.15.130:6816/3863300924 conn(0x7f70c4070cd0 0x7f70c4073190 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f70d40ae000 tx=0x7f70d40a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:18.567 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.570+0000 7f70d2ffd640 1 -- 172.21.15.130:0/3663819296 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7f70dc022070 con 0x7f70e41410b0 2024-06-11T17:18:18.745 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.746+0000 7f70e8db7640 1 -- 172.21.15.130:0/3663819296 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f70e41d89f0 con 0x7f70e41410b0 2024-06-11T17:18:18.746 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.746+0000 7f70d2ffd640 1 -- 172.21.15.130:0/3663819296 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+9054 (secure 0 0 0) 0x7f70dc010040 con 0x7f70e41410b0 2024-06-11T17:18:18.746 INFO:teuthology.misc.health.smithi130.stdout: 2024-06-11T17:18:18.746 INFO:teuthology.misc.health.smithi130.stdout:{"epoch":14,"fsid":"fae1d0b0-28f2-4ebc-8a2f-59aed9de5555","created":"2024-06-11T17:18:08.122125+0000","modified":"2024-06-11T17:18:18.550650+0000","last_up_change":"2024-06-11T17:18:18.550650+0000","last_in_change":"2024-06-11T17:18:10.336508+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0bb385e4-fde4-44a5-a9ca-491e3a80dd65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":1675918119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":1675918119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":1675918119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":1675918119}]},"public_addr":"172.21.15.130:6800/1675918119","cluster_addr":"172.21.15.130:6801/1675918119","heartbeat_back_addr":"172.21.15.130:6803/1675918119","heartbeat_front_addr":"172.21.15.130:6802/1675918119","state":["exists","up"]},{"osd":1,"uuid":"b96b90b9-e209-41df-9235-5ee65fc63857","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":1676407705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":1676407705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":1676407705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":1676407705}]},"public_addr":"172.21.15.130:6804/1676407705","cluster_addr":"172.21.15.130:6805/1676407705","heartbeat_back_addr":"172.21.15.130:6807/1676407705","heartbeat_front_addr":"172.21.15.130:6806/1676407705","state":["exists","up"]},{"osd":2,"uuid":"4f935459-1234-4e49-86b9-0a5963e12faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":272447947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":272447947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":272447947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":272447947}]},"public_addr":"172.21.15.130:6808/272447947","cluster_addr":"172.21.15.130:6809/272447947","heartbeat_back_addr":"172.21.15.130:6813/272447947","heartbeat_front_addr":"172.21.15.130:6811/272447947","state":["exists","up"]},{"osd":3,"uuid":"e232dcd6-4ef9-4a81-a427-bf9efcccd670","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":995804279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":995804279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":995804279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":995804279}]},"public_addr":"172.21.15.130:6810/995804279","cluster_addr":"172.21.15.130:6812/995804279","heartbeat_back_addr":"172.21.15.130:6815/995804279","heartbeat_front_addr":"172.21.15.130:6814/995804279","state":["exists","up"]},{"osd":4,"uuid":"1370f2fe-be19-41e6-8476-a59ad515bd69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":1264612709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":1264612709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6815","nonce":1264612709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":1264612709}]},"public_addr":"172.21.15.172:6812/1264612709","cluster_addr":"172.21.15.172:6813/1264612709","heartbeat_back_addr":"172.21.15.172:6815/1264612709","heartbeat_front_addr":"172.21.15.172:6814/1264612709","state":["exists","up"]},{"osd":5,"uuid":"c0e83219-1ebf-4d46-83b6-3ca844bbcfe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":63774775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":63774775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":63774775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":63774775}]},"public_addr":"172.21.15.172:6800/63774775","cluster_addr":"172.21.15.172:6802/63774775","heartbeat_back_addr":"172.21.15.172:6806/63774775","heartbeat_front_addr":"172.21.15.172:6804/63774775","state":["exists","up"]},{"osd":6,"uuid":"08334a75-d052-4cb8-ae48-5908947f920f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":1734469189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":1734469189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6811","nonce":1734469189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":1734469189}]},"public_addr":"172.21.15.172:6808/1734469189","cluster_addr":"172.21.15.172:6809/1734469189","heartbeat_back_addr":"172.21.15.172:6811/1734469189","heartbeat_front_addr":"172.21.15.172:6810/1734469189","state":["exists","up"]},{"osd":7,"uuid":"ec87f14f-b324-47e4-9740-fb304bf3d963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6801","nonce":3950047248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6803","nonce":3950047248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6807","nonce":3950047248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3950047248}]},"public_addr":"172.21.15.172:6801/3950047248","cluster_addr":"172.21.15.172:6803/3950047248","heartbeat_back_addr":"172.21.15.172:6807/3950047248","heartbeat_front_addr":"172.21.15.172:6805/3950047248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T17:18:15.963078+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T17:18:15.983728+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T17:18:15.940511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-11T17:18:18.749 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.750+0000 7f70e8db7640 1 -- 172.21.15.130:0/3663819296 >> v2:172.21.15.130:6816/3863300924 conn(0x7f70c4070cd0 msgr2=0x7f70c4073190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:18.749 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.750+0000 7f70e8db7640 1 --2- 172.21.15.130:0/3663819296 >> v2:172.21.15.130:6816/3863300924 conn(0x7f70c4070cd0 0x7f70c4073190 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f70d40ae000 tx=0x7f70d40a7000 comp rx=0 tx=0).stop 2024-06-11T17:18:18.749 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.750+0000 7f70e8db7640 1 -- 172.21.15.130:0/3663819296 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70e41410b0 msgr2=0x7f70e41d91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:18.749 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.750+0000 7f70e8db7640 1 --2- 172.21.15.130:0/3663819296 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70e41410b0 0x7f70e41d91d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f70dc00efc0 tx=0x7f70dc00c490 comp rx=0 tx=0).stop 2024-06-11T17:18:18.749 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.750+0000 7f70e8db7640 1 -- 172.21.15.130:0/3663819296 shutdown_connections 2024-06-11T17:18:18.749 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.750+0000 7f70e8db7640 1 --2- 172.21.15.130:0/3663819296 >> v2:172.21.15.130:6816/3863300924 conn(0x7f70c4070cd0 0x7f70c4073190 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:18.749 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.750+0000 7f70e8db7640 1 --2- 172.21.15.130:0/3663819296 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70e41410b0 0x7f70e41d91d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:18.749 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.750+0000 7f70e8db7640 1 --2- 172.21.15.130:0/3663819296 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70e413dc90 0x7f70e41d8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:18.749 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.750+0000 7f70e8db7640 1 --2- 172.21.15.130:0/3663819296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70e40ae000 0x7f70e4073650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:18.749 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.750+0000 7f70e8db7640 1 -- 172.21.15.130:0/3663819296 >> 172.21.15.130:0/3663819296 conn(0x7f70e40b1190 msgr2=0x7f70e40ae570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:18.749 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.750+0000 7f70e8db7640 1 -- 172.21.15.130:0/3663819296 shutdown_connections 2024-06-11T17:18:18.749 INFO:teuthology.misc.health.smithi130.stderr:2024-06-11T17:18:18.750+0000 7f70e8db7640 1 -- 172.21.15.130:0/3663819296 wait complete. 2024-06-11T17:18:18.764 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-06-11T17:18:18.764 INFO:tasks.ceph:Creating RBD pool 2024-06-11T17:18:18.764 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd pool create rbd 8 2024-06-11T17:18:18.882 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.882+0000 7f7a94e52640 1 Processor -- start 2024-06-11T17:18:18.883 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.882+0000 7f7a94e52640 1 -- start start 2024-06-11T17:18:18.884 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.886+0000 7f7a94e52640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7a90140be0 0x7f7a90141020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:18.884 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.886+0000 7f7a94e52640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7a90141560 0x7f7a9014b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:18.884 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.886+0000 7f7a94e52640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a900aede0 con 0x7f7a900aca80 2024-06-11T17:18:18.884 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.886+0000 7f7a94e52640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f7a900ad790 con 0x7f7a90140be0 2024-06-11T17:18:18.884 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.886+0000 7f7a94e52640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f7a900adbe0 con 0x7f7a90141560 2024-06-11T17:18:18.884 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.886+0000 7f7a8dd9b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7a90140be0 0x7f7a90141020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:18.884 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.886+0000 7f7a8dd9b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7a90140be0 0x7f7a90141020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38254/0 (socket says 172.21.15.130:38254) 2024-06-11T17:18:18.884 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.886+0000 7f7a8dd9b640 1 -- 172.21.15.130:0/3005030592 learned_addr learned my addr 172.21.15.130:0/3005030592 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:18.885 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.886+0000 7f7a8ed9d640 1 --2- 172.21.15.130:0/3005030592 >> v2:172.21.15.172:3300/0 conn(0x7f7a90141560 0x7f7a9014b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:18.885 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.886+0000 7f7a8dd9b640 1 -- 172.21.15.130:0/3005030592 >> v2:172.21.15.172:3300/0 conn(0x7f7a90141560 msgr2=0x7f7a9014b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:18.885 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.886+0000 7f7a8dd9b640 1 --2- 172.21.15.130:0/3005030592 >> v2:172.21.15.172:3300/0 conn(0x7f7a90141560 0x7f7a9014b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:18.885 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.886+0000 7f7a8dd9b640 1 -- 172.21.15.130:0/3005030592 >> v1:172.21.15.130:6789/0 conn(0x7f7a900aca80 legacy=0x7f7a9013dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:18.885 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.886+0000 7f7a8dd9b640 1 -- 172.21.15.130:0/3005030592 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a900ad240 con 0x7f7a90140be0 2024-06-11T17:18:18.885 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.886+0000 7f7a8d59a640 1 -- 172.21.15.130:0/3005030592 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3377703247 0 0) 0x7f7a900aede0 con 0x7f7a900aca80 2024-06-11T17:18:18.885 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.886+0000 7f7a8ed9d640 1 --2- 172.21.15.130:0/3005030592 >> v2:172.21.15.172:3300/0 conn(0x7f7a90141560 0x7f7a9014b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-11T17:18:18.885 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.886+0000 7f7a8dd9b640 1 --2- 172.21.15.130:0/3005030592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a90140be0 0x7f7a90141020 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7a90073b40 tx=0x7f7a8401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b49e60f3417d338 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:18.886 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.886+0000 7f7a8d59a640 1 -- 172.21.15.130:0/3005030592 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a840aa5f0 con 0x7f7a90140be0 2024-06-11T17:18:18.887 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.886+0000 7f7a8d59a640 1 -- 172.21.15.130:0/3005030592 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a840af070 con 0x7f7a90140be0 2024-06-11T17:18:18.887 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.886+0000 7f7a8d59a640 1 -- 172.21.15.130:0/3005030592 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a840aa9b0 con 0x7f7a90140be0 2024-06-11T17:18:18.887 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.886+0000 7f7a94e52640 1 -- 172.21.15.130:0/3005030592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a90140be0 msgr2=0x7f7a90141020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:18.887 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.886+0000 7f7a94e52640 1 --2- 172.21.15.130:0/3005030592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a90140be0 0x7f7a90141020 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7a90073b40 tx=0x7f7a8401c470 comp rx=0 tx=0).stop 2024-06-11T17:18:18.887 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.886+0000 7f7a94e52640 1 -- 172.21.15.130:0/3005030592 shutdown_connections 2024-06-11T17:18:18.887 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.886+0000 7f7a94e52640 1 --2- 172.21.15.130:0/3005030592 >> v2:172.21.15.172:3300/0 conn(0x7f7a90141560 0x7f7a9014b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:18.887 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.886+0000 7f7a94e52640 1 --2- 172.21.15.130:0/3005030592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a90140be0 0x7f7a90141020 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:18.887 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.886+0000 7f7a94e52640 1 -- 172.21.15.130:0/3005030592 >> 172.21.15.130:0/3005030592 conn(0x7f7a900b46b0 msgr2=0x7f7a900b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:18.887 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.886+0000 7f7a94e52640 1 -- 172.21.15.130:0/3005030592 shutdown_connections 2024-06-11T17:18:18.887 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.886+0000 7f7a94e52640 1 -- 172.21.15.130:0/3005030592 wait complete. 2024-06-11T17:18:18.890 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.890+0000 7f7a94e52640 1 Processor -- start 2024-06-11T17:18:18.890 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.890+0000 7f7a94e52640 1 -- start start 2024-06-11T17:18:18.890 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.890+0000 7f7a94e52640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a900aca80 0x7f7a90072a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:18.890 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.890+0000 7f7a94e52640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a90140be0 0x7f7a90144f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:18.890 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.890+0000 7f7a94e52640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a90141560 0x7f7a90145490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:18.890 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.890+0000 7f7a94e52640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9014df30 con 0x7f7a90140be0 2024-06-11T17:18:18.890 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.890+0000 7f7a94e52640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7a90073dc0 con 0x7f7a90141560 2024-06-11T17:18:18.890 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.890+0000 7f7a94e52640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f7a9014e0b0 con 0x7f7a900aca80 2024-06-11T17:18:18.890 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.890+0000 7f7a8dd9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a90140be0 0x7f7a90144f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:18.890 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.890+0000 7f7a8dd9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a90140be0 0x7f7a90144f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38264/0 (socket says 172.21.15.130:38264) 2024-06-11T17:18:18.890 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.890+0000 7f7a8dd9b640 1 -- 172.21.15.130:0/2449118148 learned_addr learned my addr 172.21.15.130:0/2449118148 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:18.891 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.890+0000 7f7a8e59c640 1 --2- 172.21.15.130:0/2449118148 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a900aca80 0x7f7a90072a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:18.891 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.890+0000 7f7a8ed9d640 1 --2- 172.21.15.130:0/2449118148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a90141560 0x7f7a90145490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:18.891 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.890+0000 7f7a8dd9b640 1 -- 172.21.15.130:0/2449118148 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a900aca80 msgr2=0x7f7a90072a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:18.891 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.890+0000 7f7a8dd9b640 1 --2- 172.21.15.130:0/2449118148 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a900aca80 0x7f7a90072a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:18.891 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.890+0000 7f7a8dd9b640 1 -- 172.21.15.130:0/2449118148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a90141560 msgr2=0x7f7a90145490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:18.891 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.890+0000 7f7a8dd9b640 1 --2- 172.21.15.130:0/2449118148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a90141560 0x7f7a90145490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:18.891 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.890+0000 7f7a8dd9b640 1 -- 172.21.15.130:0/2449118148 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a90146590 con 0x7f7a90140be0 2024-06-11T17:18:18.891 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.890+0000 7f7a8e59c640 1 --2- 172.21.15.130:0/2449118148 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a900aca80 0x7f7a90072a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:18:18.891 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.890+0000 7f7a8ed9d640 1 --2- 172.21.15.130:0/2449118148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a90141560 0x7f7a90145490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-11T17:18:18.891 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.890+0000 7f7a8dd9b640 1 --2- 172.21.15.130:0/2449118148 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a90140be0 0x7f7a90144f50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7a84019080 tx=0x7f7a8401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:18.891 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.890+0000 7f7a7effd640 1 -- 172.21.15.130:0/2449118148 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a840b3600 con 0x7f7a90140be0 2024-06-11T17:18:18.891 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.890+0000 7f7a7effd640 1 -- 172.21.15.130:0/2449118148 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a840b37a0 con 0x7f7a90140be0 2024-06-11T17:18:18.891 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.890+0000 7f7a7effd640 1 -- 172.21.15.130:0/2449118148 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a840b3b90 con 0x7f7a90140be0 2024-06-11T17:18:18.891 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.890+0000 7f7a94e52640 1 -- 172.21.15.130:0/2449118148 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a90146870 con 0x7f7a90140be0 2024-06-11T17:18:18.892 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.890+0000 7f7a94e52640 1 -- 172.21.15.130:0/2449118148 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a901459d0 con 0x7f7a90140be0 2024-06-11T17:18:18.892 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.890+0000 7f7a94e52640 1 -- 172.21.15.130:0/2449118148 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a90141020 con 0x7f7a90140be0 2024-06-11T17:18:18.892 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.894+0000 7f7a7effd640 1 -- 172.21.15.130:0/2449118148 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 4) ==== 94213+0+0 (secure 0 0 0) 0x7f7a840c73e0 con 0x7f7a90140be0 2024-06-11T17:18:18.893 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.894+0000 7f7a7effd640 1 --2- 172.21.15.130:0/2449118148 >> v2:172.21.15.130:6816/3863300924 conn(0x7f7a70070cd0 0x7f7a70073190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:18.893 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.894+0000 7f7a7effd640 1 -- 172.21.15.130:0/2449118148 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3351+0+0 (secure 0 0 0) 0x7f7a8412af70 con 0x7f7a90140be0 2024-06-11T17:18:18.893 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.894+0000 7f7a8e59c640 1 --2- 172.21.15.130:0/2449118148 >> v2:172.21.15.130:6816/3863300924 conn(0x7f7a70070cd0 0x7f7a70073190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:18.893 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.894+0000 7f7a8e59c640 1 --2- 172.21.15.130:0/2449118148 >> v2:172.21.15.130:6816/3863300924 conn(0x7f7a70070cd0 0x7f7a70073190 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7a80000f70 tx=0x7f7a80009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:18.896 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:18.898+0000 7f7a7effd640 1 -- 172.21.15.130:0/2449118148 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7f7a840160f0 con 0x7f7a90140be0 2024-06-11T17:18:19.050 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.050+0000 7f7a94e52640 1 -- 172.21.15.130:0/2449118148 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f7a900715b0 con 0x7f7a90140be0 2024-06-11T17:18:19.551 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.554+0000 7f7a7effd640 1 -- 172.21.15.130:0/2449118148 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) ==== 109+0+0 (secure 0 0 0) 0x7f7a840f7710 con 0x7f7a90140be0 2024-06-11T17:18:19.552 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'rbd' created 2024-06-11T17:18:19.557 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.558+0000 7f7a94e52640 1 -- 172.21.15.130:0/2449118148 >> v2:172.21.15.130:6816/3863300924 conn(0x7f7a70070cd0 msgr2=0x7f7a70073190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:19.557 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.558+0000 7f7a94e52640 1 --2- 172.21.15.130:0/2449118148 >> v2:172.21.15.130:6816/3863300924 conn(0x7f7a70070cd0 0x7f7a70073190 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7a80000f70 tx=0x7f7a80009040 comp rx=0 tx=0).stop 2024-06-11T17:18:19.557 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.558+0000 7f7a94e52640 1 -- 172.21.15.130:0/2449118148 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a90140be0 msgr2=0x7f7a90144f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:19.557 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.558+0000 7f7a94e52640 1 --2- 172.21.15.130:0/2449118148 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a90140be0 0x7f7a90144f50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7a84019080 tx=0x7f7a8401acb0 comp rx=0 tx=0).stop 2024-06-11T17:18:19.557 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.558+0000 7f7a94e52640 1 -- 172.21.15.130:0/2449118148 shutdown_connections 2024-06-11T17:18:19.557 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.558+0000 7f7a94e52640 1 --2- 172.21.15.130:0/2449118148 >> v2:172.21.15.130:6816/3863300924 conn(0x7f7a70070cd0 0x7f7a70073190 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:19.557 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.558+0000 7f7a94e52640 1 --2- 172.21.15.130:0/2449118148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a90141560 0x7f7a90145490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:19.557 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.558+0000 7f7a94e52640 1 --2- 172.21.15.130:0/2449118148 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a90140be0 0x7f7a90144f50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:19.557 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.558+0000 7f7a94e52640 1 --2- 172.21.15.130:0/2449118148 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a900aca80 0x7f7a90072a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:19.557 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.558+0000 7f7a94e52640 1 -- 172.21.15.130:0/2449118148 >> 172.21.15.130:0/2449118148 conn(0x7f7a900b46b0 msgr2=0x7f7a900b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:19.557 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.558+0000 7f7a94e52640 1 -- 172.21.15.130:0/2449118148 shutdown_connections 2024-06-11T17:18:19.557 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.558+0000 7f7a94e52640 1 -- 172.21.15.130:0/2449118148 wait complete. 2024-06-11T17:18:19.577 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-06-11T17:18:19.700 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.702+0000 7f4a38259640 1 Processor -- start 2024-06-11T17:18:19.700 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.702+0000 7f4a38259640 1 -- start start 2024-06-11T17:18:19.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.702+0000 7f4a38259640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4a300acb60 0x7f4a300af120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:19.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.702+0000 7f4a38259640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4a3013a4e0 0x7f4a3013a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:19.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.702+0000 7f4a38259640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a301417c0 con 0x7f4a300ad2c0 2024-06-11T17:18:19.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.702+0000 7f4a38259640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f4a300ad6a0 con 0x7f4a300acb60 2024-06-11T17:18:19.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.702+0000 7f4a38259640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4a300ae9f0 con 0x7f4a3013a4e0 2024-06-11T17:18:19.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.702+0000 7f4a367f6640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4a3013a4e0 0x7f4a3013a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:19.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.702+0000 7f4a357f4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4a300acb60 0x7f4a300af120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:19.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.702+0000 7f4a367f6640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4a3013a4e0 0x7f4a3013a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:53396/0 (socket says 172.21.15.130:53396) 2024-06-11T17:18:19.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.702+0000 7f4a367f6640 1 -- 172.21.15.130:0/3833489133 learned_addr learned my addr 172.21.15.130:0/3833489133 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:19.703 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.702+0000 7f4a357f4640 1 -- 172.21.15.130:0/3833489133 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4a3013a4e0 msgr2=0x7f4a3013a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:19.703 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.702+0000 7f4a357f4640 1 --2- 172.21.15.130:0/3833489133 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4a3013a4e0 0x7f4a3013a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:19.703 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.702+0000 7f4a357f4640 1 -- 172.21.15.130:0/3833489133 >> v1:172.21.15.130:6789/0 conn(0x7f4a300ad2c0 legacy=0x7f4a301410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:19.703 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.702+0000 7f4a357f4640 1 -- 172.21.15.130:0/3833489133 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a300aecd0 con 0x7f4a300acb60 2024-06-11T17:18:19.704 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.706+0000 7f4a357f4640 1 --2- 172.21.15.130:0/3833489133 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a300acb60 0x7f4a300af120 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0097c0 tx=0x7f4a2c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84c36e3d61e9685b server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:19.704 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.706+0000 7f4a34ff3640 1 -- 172.21.15.130:0/3833489133 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c0b1070 con 0x7f4a300acb60 2024-06-11T17:18:19.704 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.706+0000 7f4a34ff3640 1 -- 172.21.15.130:0/3833489133 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a2c0ac620 con 0x7f4a300acb60 2024-06-11T17:18:19.704 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.706+0000 7f4a34ff3640 1 -- 172.21.15.130:0/3833489133 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c0ac9f0 con 0x7f4a300acb60 2024-06-11T17:18:19.705 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.706+0000 7f4a38259640 1 -- 172.21.15.130:0/3833489133 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a300acb60 msgr2=0x7f4a300af120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:19.705 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.706+0000 7f4a38259640 1 --2- 172.21.15.130:0/3833489133 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a300acb60 0x7f4a300af120 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0097c0 tx=0x7f4a2c01c3c0 comp rx=0 tx=0).stop 2024-06-11T17:18:19.705 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.706+0000 7f4a38259640 1 -- 172.21.15.130:0/3833489133 shutdown_connections 2024-06-11T17:18:19.705 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.706+0000 7f4a38259640 1 --2- 172.21.15.130:0/3833489133 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4a3013a4e0 0x7f4a3013a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:19.705 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.706+0000 7f4a38259640 1 --2- 172.21.15.130:0/3833489133 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a300acb60 0x7f4a300af120 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:19.705 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.706+0000 7f4a38259640 1 -- 172.21.15.130:0/3833489133 >> 172.21.15.130:0/3833489133 conn(0x7f4a3006cb60 msgr2=0x7f4a300b4720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:19.705 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.706+0000 7f4a38259640 1 -- 172.21.15.130:0/3833489133 shutdown_connections 2024-06-11T17:18:19.705 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.706+0000 7f4a38259640 1 -- 172.21.15.130:0/3833489133 wait complete. 2024-06-11T17:18:19.707 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.706+0000 7f4a38259640 1 Processor -- start 2024-06-11T17:18:19.707 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.706+0000 7f4a38259640 1 -- start start 2024-06-11T17:18:19.708 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.706+0000 7f4a38259640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a300acb60 0x7f4a3013cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:19.708 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.706+0000 7f4a38259640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a300ad2c0 0x7f4a300705a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:19.708 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.706+0000 7f4a38259640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4a3013a4e0 0x7f4a30071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:19.708 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.706+0000 7f4a38259640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3014dd70 con 0x7f4a300ad2c0 2024-06-11T17:18:19.708 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.706+0000 7f4a38259640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3014dbf0 con 0x7f4a300acb60 2024-06-11T17:18:19.708 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.706+0000 7f4a38259640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4a3014def0 con 0x7f4a3013a4e0 2024-06-11T17:18:19.708 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.706+0000 7f4a357f4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a300ad2c0 0x7f4a300705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:19.708 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.706+0000 7f4a357f4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a300ad2c0 0x7f4a300705a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38276/0 (socket says 172.21.15.130:38276) 2024-06-11T17:18:19.708 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.706+0000 7f4a357f4640 1 -- 172.21.15.130:0/916505244 learned_addr learned my addr 172.21.15.130:0/916505244 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:19.708 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.706+0000 7f4a367f6640 1 --2- 172.21.15.130:0/916505244 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4a3013a4e0 0x7f4a30071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:19.708 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.706+0000 7f4a35ff5640 1 --2- 172.21.15.130:0/916505244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a300acb60 0x7f4a3013cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:19.708 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.706+0000 7f4a357f4640 1 -- 172.21.15.130:0/916505244 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4a3013a4e0 msgr2=0x7f4a30071210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:19.708 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.706+0000 7f4a357f4640 1 --2- 172.21.15.130:0/916505244 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4a3013a4e0 0x7f4a30071210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:19.709 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.706+0000 7f4a357f4640 1 -- 172.21.15.130:0/916505244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a300acb60 msgr2=0x7f4a3013cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:19.709 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.706+0000 7f4a357f4640 1 --2- 172.21.15.130:0/916505244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a300acb60 0x7f4a3013cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:19.709 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.706+0000 7f4a357f4640 1 -- 172.21.15.130:0/916505244 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a30072920 con 0x7f4a300ad2c0 2024-06-11T17:18:19.709 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.710+0000 7f4a357f4640 1 --2- 172.21.15.130:0/916505244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a300ad2c0 0x7f4a300705a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0af040 tx=0x7f4a2c019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:19.709 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.710+0000 7f4a267fc640 1 -- 172.21.15.130:0/916505244 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c0b9020 con 0x7f4a300ad2c0 2024-06-11T17:18:19.709 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.710+0000 7f4a267fc640 1 -- 172.21.15.130:0/916505244 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a2c0b5410 con 0x7f4a300ad2c0 2024-06-11T17:18:19.709 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.710+0000 7f4a38259640 1 -- 172.21.15.130:0/916505244 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a30072c00 con 0x7f4a300ad2c0 2024-06-11T17:18:19.709 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.710+0000 7f4a267fc640 1 -- 172.21.15.130:0/916505244 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c0b1040 con 0x7f4a300ad2c0 2024-06-11T17:18:19.709 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.710+0000 7f4a38259640 1 -- 172.21.15.130:0/916505244 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a301dc2b0 con 0x7f4a300ad2c0 2024-06-11T17:18:19.710 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.710+0000 7f4a38259640 1 -- 172.21.15.130:0/916505244 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a300af120 con 0x7f4a300ad2c0 2024-06-11T17:18:19.710 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.710+0000 7f4a267fc640 1 -- 172.21.15.130:0/916505244 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 4) ==== 94213+0+0 (secure 0 0 0) 0x7f4a2c0bc020 con 0x7f4a300ad2c0 2024-06-11T17:18:19.710 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.710+0000 7f4a267fc640 1 --2- 172.21.15.130:0/916505244 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4a14070cd0 0x7f4a14073190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:19.710 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.710+0000 7f4a267fc640 1 -- 172.21.15.130:0/916505244 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4068+0+0 (secure 0 0 0) 0x7f4a2c12a450 con 0x7f4a300ad2c0 2024-06-11T17:18:19.710 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.710+0000 7f4a35ff5640 1 --2- 172.21.15.130:0/916505244 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4a14070cd0 0x7f4a14073190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:19.710 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.710+0000 7f4a35ff5640 1 --2- 172.21.15.130:0/916505244 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4a14070cd0 0x7f4a14073190 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4a20001610 tx=0x7f4a20009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:19.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.714+0000 7f4a267fc640 1 -- 172.21.15.130:0/916505244 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7f4a2c0c3030 con 0x7f4a300ad2c0 2024-06-11T17:18:19.869 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:19.870+0000 7f4a38259640 1 -- 172.21.15.130:0/916505244 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) -- 0x7f4a300b27c0 con 0x7f4a300ad2c0 2024-06-11T17:18:20.554 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.554+0000 7f4a267fc640 1 -- 172.21.15.130:0/916505244 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v16) ==== 173+0+0 (secure 0 0 0) 0x7f4a2c016070 con 0x7f4a300ad2c0 2024-06-11T17:18:20.554 INFO:teuthology.orchestra.run.smithi130.stderr:enabled application 'rbd' on pool 'rbd' 2024-06-11T17:18:20.558 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.558+0000 7f4a38259640 1 -- 172.21.15.130:0/916505244 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4a14070cd0 msgr2=0x7f4a14073190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:20.558 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.558+0000 7f4a38259640 1 --2- 172.21.15.130:0/916505244 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4a14070cd0 0x7f4a14073190 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4a20001610 tx=0x7f4a20009040 comp rx=0 tx=0).stop 2024-06-11T17:18:20.558 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.558+0000 7f4a38259640 1 -- 172.21.15.130:0/916505244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a300ad2c0 msgr2=0x7f4a300705a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:20.558 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.558+0000 7f4a38259640 1 --2- 172.21.15.130:0/916505244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a300ad2c0 0x7f4a300705a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0af040 tx=0x7f4a2c019160 comp rx=0 tx=0).stop 2024-06-11T17:18:20.558 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.558+0000 7f4a38259640 1 -- 172.21.15.130:0/916505244 shutdown_connections 2024-06-11T17:18:20.558 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.558+0000 7f4a38259640 1 --2- 172.21.15.130:0/916505244 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4a14070cd0 0x7f4a14073190 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:20.559 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.558+0000 7f4a38259640 1 --2- 172.21.15.130:0/916505244 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4a3013a4e0 0x7f4a30071210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:20.559 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.558+0000 7f4a38259640 1 --2- 172.21.15.130:0/916505244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a300ad2c0 0x7f4a300705a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:20.559 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.558+0000 7f4a38259640 1 --2- 172.21.15.130:0/916505244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a300acb60 0x7f4a3013cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:20.559 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.558+0000 7f4a38259640 1 -- 172.21.15.130:0/916505244 >> 172.21.15.130:0/916505244 conn(0x7f4a3006cb60 msgr2=0x7f4a3013fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:20.559 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.558+0000 7f4a38259640 1 -- 172.21.15.130:0/916505244 shutdown_connections 2024-06-11T17:18:20.559 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.558+0000 7f4a38259640 1 -- 172.21.15.130:0/916505244 wait complete. 2024-06-11T17:18:20.582 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-06-11T17:18:20.583 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-06-11T17:18:20.583 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-06-11T17:18:20.712 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.714+0000 7f3f33bf4640 1 Processor -- start 2024-06-11T17:18:20.712 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.714+0000 7f3f33bf4640 1 -- start start 2024-06-11T17:18:20.713 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.714+0000 7f3f33bf4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3f2c06ffb0 0x7f3f2c13c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:20.713 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.714+0000 7f3f33bf4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3f2c13c890 0x7f3f2c13f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:20.713 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.714+0000 7f3f33bf4640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f2c071f30 con 0x7f3f2c13f7f0 2024-06-11T17:18:20.713 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.714+0000 7f3f33bf4640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f3f2c071040 con 0x7f3f2c13c890 2024-06-11T17:18:20.713 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.714+0000 7f3f33bf4640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f3f2c072210 con 0x7f3f2c06ffb0 2024-06-11T17:18:20.713 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.714+0000 7f3f3118f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3f2c13c890 0x7f3f2c13f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:20.713 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.714+0000 7f3f32191640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f3f2c13f7f0 0x7f3f2c142640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:35316/0 (socket says 172.21.15.130:35316) 2024-06-11T17:18:20.713 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.714+0000 7f3f32191640 1 -- 172.21.15.130:0/1200626081 learned_addr learned my addr 172.21.15.130:0/1200626081 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-06-11T17:18:20.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.714+0000 7f3f31990640 1 --2- 172.21.15.130:0/1200626081 >> v2:172.21.15.172:3300/0 conn(0x7f3f2c06ffb0 0x7f3f2c13c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:20.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.714+0000 7f3f3118f640 1 -- 172.21.15.130:0/1200626081 >> v2:172.21.15.172:3300/0 conn(0x7f3f2c06ffb0 msgr2=0x7f3f2c13c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:20.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.714+0000 7f3f3118f640 1 --2- 172.21.15.130:0/1200626081 >> v2:172.21.15.172:3300/0 conn(0x7f3f2c06ffb0 0x7f3f2c13c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:20.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.714+0000 7f3f3118f640 1 -- 172.21.15.130:0/1200626081 >> v1:172.21.15.130:6789/0 conn(0x7f3f2c13f7f0 legacy=0x7f3f2c142640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:20.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.714+0000 7f3f3098e640 1 -- 172.21.15.130:0/1200626081 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1534057517 0 0) 0x7f3f2c071f30 con 0x7f3f2c13f7f0 2024-06-11T17:18:20.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.714+0000 7f3f3118f640 1 -- 172.21.15.130:0/1200626081 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f2c13ccb0 con 0x7f3f2c13c890 2024-06-11T17:18:20.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f3118f640 1 --2- 172.21.15.130:0/1200626081 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f2c13c890 0x7f3f2c13f2b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c06d130 tx=0x7f3f1c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df9e3d7e9d3b46d server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:20.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f3098e640 1 -- 172.21.15.130:0/1200626081 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c0b0070 con 0x7f3f2c13c890 2024-06-11T17:18:20.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f3098e640 1 -- 172.21.15.130:0/1200626081 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f1c0ab600 con 0x7f3f2c13c890 2024-06-11T17:18:20.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f3098e640 1 -- 172.21.15.130:0/1200626081 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c0ab9d0 con 0x7f3f2c13c890 2024-06-11T17:18:20.716 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f33bf4640 1 -- 172.21.15.130:0/1200626081 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f2c13c890 msgr2=0x7f3f2c13f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:20.716 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f33bf4640 1 --2- 172.21.15.130:0/1200626081 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f2c13c890 0x7f3f2c13f2b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c06d130 tx=0x7f3f1c01c3d0 comp rx=0 tx=0).stop 2024-06-11T17:18:20.717 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f33bf4640 1 -- 172.21.15.130:0/1200626081 shutdown_connections 2024-06-11T17:18:20.717 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f33bf4640 1 --2- 172.21.15.130:0/1200626081 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f2c13c890 0x7f3f2c13f2b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:20.717 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f33bf4640 1 --2- 172.21.15.130:0/1200626081 >> v2:172.21.15.172:3300/0 conn(0x7f3f2c06ffb0 0x7f3f2c13c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:20.717 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f33bf4640 1 -- 172.21.15.130:0/1200626081 >> 172.21.15.130:0/1200626081 conn(0x7f3f2c0b4fd0 msgr2=0x7f3f2c0b53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:20.717 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f33bf4640 1 -- 172.21.15.130:0/1200626081 shutdown_connections 2024-06-11T17:18:20.717 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f33bf4640 1 -- 172.21.15.130:0/1200626081 wait complete. 2024-06-11T17:18:20.719 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f33bf4640 1 Processor -- start 2024-06-11T17:18:20.719 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f33bf4640 1 -- start start 2024-06-11T17:18:20.719 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f33bf4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f2c06ffb0 0x7f3f2c1dec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:20.719 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f33bf4640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f2c13c890 0x7f3f2c1df190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:20.719 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f33bf4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f2c13f7f0 0x7f3f2c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:20.719 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f33bf4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3f2c1430e0 con 0x7f3f2c13f7f0 2024-06-11T17:18:20.719 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f33bf4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3f2c142f60 con 0x7f3f2c06ffb0 2024-06-11T17:18:20.720 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f33bf4640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f3f2c143260 con 0x7f3f2c13c890 2024-06-11T17:18:20.720 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f3118f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f2c13c890 0x7f3f2c1df190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:20.720 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f32191640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f2c13f7f0 0x7f3f2c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:20.720 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f3118f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f2c13c890 0x7f3f2c1df190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:53416/0 (socket says 172.21.15.130:53416) 2024-06-11T17:18:20.720 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f3118f640 1 -- 172.21.15.130:0/3738914204 learned_addr learned my addr 172.21.15.130:0/3738914204 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:20.720 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f31990640 1 --2- 172.21.15.130:0/3738914204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f2c06ffb0 0x7f3f2c1dec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:20.720 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f3118f640 1 -- 172.21.15.130:0/3738914204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f2c06ffb0 msgr2=0x7f3f2c1dec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:20.720 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f3118f640 1 --2- 172.21.15.130:0/3738914204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f2c06ffb0 0x7f3f2c1dec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:20.720 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f3118f640 1 -- 172.21.15.130:0/3738914204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f2c13f7f0 msgr2=0x7f3f2c138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:20.720 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f3118f640 1 --2- 172.21.15.130:0/3738914204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f2c13f7f0 0x7f3f2c138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:20.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f3118f640 1 -- 172.21.15.130:0/3738914204 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f2c1df6d0 con 0x7f3f2c13c890 2024-06-11T17:18:20.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f32191640 1 --2- 172.21.15.130:0/3738914204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f2c13f7f0 0x7f3f2c138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:18:20.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f3118f640 1 --2- 172.21.15.130:0/3738914204 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f2c13c890 0x7f3f2c1df190 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c01a000 tx=0x7f3f1c01ac10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:20.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f227fc640 1 -- 172.21.15.130:0/3738914204 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c0b0050 con 0x7f3f2c13c890 2024-06-11T17:18:20.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f227fc640 1 -- 172.21.15.130:0/3738914204 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f1c0b1040 con 0x7f3f2c13c890 2024-06-11T17:18:20.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f33bf4640 1 -- 172.21.15.130:0/3738914204 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f2c0ace40 con 0x7f3f2c13c890 2024-06-11T17:18:20.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f227fc640 1 -- 172.21.15.130:0/3738914204 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c004240 con 0x7f3f2c13c890 2024-06-11T17:18:20.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.718+0000 7f3f33bf4640 1 -- 172.21.15.130:0/3738914204 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f2c0ad400 con 0x7f3f2c13c890 2024-06-11T17:18:20.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.722+0000 7f3f0ffff640 1 -- 172.21.15.130:0/3738914204 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f2c13c350 con 0x7f3f2c13c890 2024-06-11T17:18:20.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.722+0000 7f3f227fc640 1 -- 172.21.15.130:0/3738914204 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 4) ==== 94213+0+0 (secure 0 0 0) 0x7f3f1c0be060 con 0x7f3f2c13c890 2024-06-11T17:18:20.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.722+0000 7f3f227fc640 1 --2- 172.21.15.130:0/3738914204 >> v2:172.21.15.130:6816/3863300924 conn(0x7f3f10070cd0 0x7f3f10073190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:20.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.722+0000 7f3f31990640 1 --2- 172.21.15.130:0/3738914204 >> v2:172.21.15.130:6816/3863300924 conn(0x7f3f10070cd0 0x7f3f10073190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:20.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.722+0000 7f3f227fc640 1 -- 172.21.15.130:0/3738914204 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(16..16 src has 1..16) ==== 4090+0+0 (secure 0 0 0) 0x7f3f1c12a250 con 0x7f3f2c13c890 2024-06-11T17:18:20.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.722+0000 7f3f31990640 1 --2- 172.21.15.130:0/3738914204 >> v2:172.21.15.130:6816/3863300924 conn(0x7f3f10070cd0 0x7f3f10073190 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800b9d0 tx=0x7f3f28008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:20.725 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.726+0000 7f3f227fc640 1 -- 172.21.15.130:0/3738914204 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7f3f1c016050 con 0x7f3f2c13c890 2024-06-11T17:18:20.894 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.894+0000 7f3f0ffff640 1 -- 172.21.15.130:0/3738914204 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f3f2c0709c0 con 0x7f3f2c13c890 2024-06-11T17:18:20.895 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.898+0000 7f3f227fc640 1 -- 172.21.15.130:0/3738914204 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v6) ==== 86+0+159 (secure 0 0 0) 0x7f3f1c0f6d10 con 0x7f3f2c13c890 2024-06-11T17:18:20.895 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:18:20.897 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.898+0000 7f3f0ffff640 1 -- 172.21.15.130:0/3738914204 >> v2:172.21.15.130:6816/3863300924 conn(0x7f3f10070cd0 msgr2=0x7f3f10073190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:20.897 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.898+0000 7f3f0ffff640 1 --2- 172.21.15.130:0/3738914204 >> v2:172.21.15.130:6816/3863300924 conn(0x7f3f10070cd0 0x7f3f10073190 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800b9d0 tx=0x7f3f28008040 comp rx=0 tx=0).stop 2024-06-11T17:18:20.897 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.898+0000 7f3f0ffff640 1 -- 172.21.15.130:0/3738914204 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f2c13c890 msgr2=0x7f3f2c1df190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:20.897 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.898+0000 7f3f0ffff640 1 --2- 172.21.15.130:0/3738914204 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f2c13c890 0x7f3f2c1df190 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c01a000 tx=0x7f3f1c01ac10 comp rx=0 tx=0).stop 2024-06-11T17:18:20.897 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.898+0000 7f3f0ffff640 1 -- 172.21.15.130:0/3738914204 shutdown_connections 2024-06-11T17:18:20.898 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.898+0000 7f3f0ffff640 1 --2- 172.21.15.130:0/3738914204 >> v2:172.21.15.130:6816/3863300924 conn(0x7f3f10070cd0 0x7f3f10073190 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:20.898 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.898+0000 7f3f0ffff640 1 --2- 172.21.15.130:0/3738914204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f2c13f7f0 0x7f3f2c138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:20.898 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.898+0000 7f3f0ffff640 1 --2- 172.21.15.130:0/3738914204 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f2c13c890 0x7f3f2c1df190 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:20.898 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.898+0000 7f3f0ffff640 1 --2- 172.21.15.130:0/3738914204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f2c06ffb0 0x7f3f2c1dec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:20.898 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.898+0000 7f3f0ffff640 1 -- 172.21.15.130:0/3738914204 >> 172.21.15.130:0/3738914204 conn(0x7f3f2c0b4fd0 msgr2=0x7f3f2c13b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:20.898 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.898+0000 7f3f0ffff640 1 -- 172.21.15.130:0/3738914204 shutdown_connections 2024-06-11T17:18:20.898 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:20.898+0000 7f3f0ffff640 1 -- 172.21.15.130:0/3738914204 wait complete. 2024-06-11T17:18:20.913 INFO:teuthology.orchestra.run.smithi130.stdout:[{"version":6,"timestamp":"2024-06-11T17:18:17.992731+0000","name":"","changes":[{"name":"osd.4/osd_mclock_max_capacity_iops_ssd","new_value":"4484.911656"}]}] 2024-06-11T17:18:20.913 INFO:tasks.ceph_manager:config epoch is 6 2024-06-11T17:18:20.913 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-06-11T17:18:20.914 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-06-11T17:18:20.914 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-06-11T17:18:21.026 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.026+0000 7f81419dc640 1 Processor -- start 2024-06-11T17:18:21.027 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.026+0000 7f81419dc640 1 -- start start 2024-06-11T17:18:21.028 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.026+0000 7f81419dc640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f813c13d190 0x7f813c14b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:21.028 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.030+0000 7f81419dc640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f813c0aedb0 con 0x7f813c13f800 2024-06-11T17:18:21.028 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.030+0000 7f81419dc640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f813c13fc00 con 0x7f813c0af310 2024-06-11T17:18:21.028 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.030+0000 7f81419dc640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f813c0af6f0 con 0x7f813c13d190 2024-06-11T17:18:21.028 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.030+0000 7f813b7fe640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f813c13d190 0x7f813c14b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:21.028 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.030+0000 7f813a7fc640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f813c13f800 0x7f813c13ca80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:35326/0 (socket says 172.21.15.130:35326) 2024-06-11T17:18:21.029 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.030+0000 7f813a7fc640 1 -- 172.21.15.130:0/3953691821 learned_addr learned my addr 172.21.15.130:0/3953691821 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-06-11T17:18:21.029 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.030+0000 7f8139ffb640 1 -- 172.21.15.130:0/3953691821 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 771218627 0 0) 0x7f813c0aedb0 con 0x7f813c13f800 2024-06-11T17:18:21.029 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.030+0000 7f813b7fe640 1 -- 172.21.15.130:0/3953691821 >> v1:172.21.15.172:6789/0 conn(0x7f813c0af310 legacy=0x7f813c0ae6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:21.029 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.030+0000 7f813b7fe640 1 -- 172.21.15.130:0/3953691821 >> v1:172.21.15.130:6789/0 conn(0x7f813c13f800 legacy=0x7f813c13ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:21.029 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.030+0000 7f813b7fe640 1 -- 172.21.15.130:0/3953691821 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f813c0aca90 con 0x7f813c13d190 2024-06-11T17:18:21.030 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.030+0000 7f813b7fe640 1 --2- 172.21.15.130:0/3953691821 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f813c13d190 0x7f813c14b100 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8134009dc0 tx=0x7f813401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2c11cf29da5cddb server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:21.030 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.030+0000 7f8139ffb640 1 -- 172.21.15.130:0/3953691821 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81340b2070 con 0x7f813c13d190 2024-06-11T17:18:21.030 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.030+0000 7f8139ffb640 1 -- 172.21.15.130:0/3953691821 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81340a58e0 con 0x7f813c13d190 2024-06-11T17:18:21.030 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.030+0000 7f8139ffb640 1 -- 172.21.15.130:0/3953691821 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81340a5cb0 con 0x7f813c13d190 2024-06-11T17:18:21.030 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.030+0000 7f81419dc640 1 -- 172.21.15.130:0/3953691821 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f813c13d190 msgr2=0x7f813c14b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:21.030 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.030+0000 7f81419dc640 1 --2- 172.21.15.130:0/3953691821 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f813c13d190 0x7f813c14b100 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8134009dc0 tx=0x7f813401c970 comp rx=0 tx=0).stop 2024-06-11T17:18:21.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.030+0000 7f81419dc640 1 -- 172.21.15.130:0/3953691821 shutdown_connections 2024-06-11T17:18:21.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.030+0000 7f81419dc640 1 --2- 172.21.15.130:0/3953691821 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f813c13d190 0x7f813c14b100 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:21.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.030+0000 7f81419dc640 1 -- 172.21.15.130:0/3953691821 >> 172.21.15.130:0/3953691821 conn(0x7f813c0b46b0 msgr2=0x7f813c0b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:21.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.030+0000 7f81419dc640 1 -- 172.21.15.130:0/3953691821 shutdown_connections 2024-06-11T17:18:21.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.030+0000 7f81419dc640 1 -- 172.21.15.130:0/3953691821 wait complete. 2024-06-11T17:18:21.033 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.034+0000 7f81419dc640 1 Processor -- start 2024-06-11T17:18:21.033 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.034+0000 7f81419dc640 1 -- start start 2024-06-11T17:18:21.033 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.034+0000 7f81419dc640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f813c0af310 0x7f813c073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:21.033 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.034+0000 7f81419dc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f813c13d190 0x7f813c146400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:21.033 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.034+0000 7f81419dc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f813c13f800 0x7f813c146940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:21.034 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.034+0000 7f81419dc640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f813c0abf50 con 0x7f813c13d190 2024-06-11T17:18:21.034 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.034+0000 7f81419dc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f813c0abdd0 con 0x7f813c13f800 2024-06-11T17:18:21.034 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.034+0000 7f81419dc640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f813c14de60 con 0x7f813c0af310 2024-06-11T17:18:21.034 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.034+0000 7f813affd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f813c0af310 0x7f813c073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:21.034 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.034+0000 7f813a7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f813c13d190 0x7f813c146400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:21.034 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.034+0000 7f813affd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f813c0af310 0x7f813c073180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:53446/0 (socket says 172.21.15.130:53446) 2024-06-11T17:18:21.034 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.034+0000 7f813a7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f813c13d190 0x7f813c146400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38318/0 (socket says 172.21.15.130:38318) 2024-06-11T17:18:21.034 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.034+0000 7f813affd640 1 -- 172.21.15.130:0/132607315 learned_addr learned my addr 172.21.15.130:0/132607315 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:21.034 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.034+0000 7f813b7fe640 1 --2- 172.21.15.130:0/132607315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f813c13f800 0x7f813c146940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:21.034 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.034+0000 7f813affd640 1 -- 172.21.15.130:0/132607315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f813c13f800 msgr2=0x7f813c146940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:21.034 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.034+0000 7f813affd640 1 --2- 172.21.15.130:0/132607315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f813c13f800 0x7f813c146940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:21.034 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.034+0000 7f813affd640 1 -- 172.21.15.130:0/132607315 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f813c13d190 msgr2=0x7f813c146400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:21.035 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.034+0000 7f813affd640 1 --2- 172.21.15.130:0/132607315 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f813c13d190 0x7f813c146400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:21.035 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.034+0000 7f813affd640 1 -- 172.21.15.130:0/132607315 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f813c0ab830 con 0x7f813c0af310 2024-06-11T17:18:21.035 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.034+0000 7f813a7fc640 1 --2- 172.21.15.130:0/132607315 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f813c13d190 0x7f813c146400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:18:21.035 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.034+0000 7f813affd640 1 --2- 172.21.15.130:0/132607315 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f813c0af310 0x7f813c073180 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f812c00c450 tx=0x7f812c00c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:21.035 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.034+0000 7f8123fff640 1 -- 172.21.15.130:0/132607315 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c012830 con 0x7f813c0af310 2024-06-11T17:18:21.035 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.034+0000 7f8123fff640 1 -- 172.21.15.130:0/132607315 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f812c017070 con 0x7f813c0af310 2024-06-11T17:18:21.035 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.034+0000 7f81419dc640 1 -- 172.21.15.130:0/132607315 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f813c147d50 con 0x7f813c0af310 2024-06-11T17:18:21.035 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.034+0000 7f8123fff640 1 -- 172.21.15.130:0/132607315 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c012c30 con 0x7f813c0af310 2024-06-11T17:18:21.035 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.034+0000 7f81419dc640 1 -- 172.21.15.130:0/132607315 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f813c145ba0 con 0x7f813c0af310 2024-06-11T17:18:21.035 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.034+0000 7f81419dc640 1 -- 172.21.15.130:0/132607315 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f813c1460f0 con 0x7f813c0af310 2024-06-11T17:18:21.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.034+0000 7f8123fff640 1 -- 172.21.15.130:0/132607315 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 4) ==== 94213+0+0 (secure 0 0 0) 0x7f812c01c460 con 0x7f813c0af310 2024-06-11T17:18:21.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.034+0000 7f8123fff640 1 --2- 172.21.15.130:0/132607315 >> v2:172.21.15.130:6816/3863300924 conn(0x7f8128070cd0 0x7f8128073190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:21.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.034+0000 7f8123fff640 1 -- 172.21.15.130:0/132607315 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(16..16 src has 1..16) ==== 4090+0+0 (secure 0 0 0) 0x7f812c090580 con 0x7f813c0af310 2024-06-11T17:18:21.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.034+0000 7f813a7fc640 1 --2- 172.21.15.130:0/132607315 >> v2:172.21.15.130:6816/3863300924 conn(0x7f8128070cd0 0x7f8128073190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:21.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.038+0000 7f813a7fc640 1 --2- 172.21.15.130:0/132607315 >> v2:172.21.15.130:6816/3863300924 conn(0x7f8128070cd0 0x7f8128073190 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f813c0736c0 tx=0x7f8130007df0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:21.038 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.038+0000 7f8123fff640 1 -- 172.21.15.130:0/132607315 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7f813c1460f0 con 0x7f813c0af310 2024-06-11T17:18:21.246 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.246+0000 7f81419dc640 1 -- 172.21.15.130:0/132607315 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f813c13ca80 con 0x7f813c0af310 2024-06-11T17:18:21.277 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.278+0000 7f8123fff640 1 -- 172.21.15.130:0/132607315 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) ==== 74+0+181633 (secure 0 0 0) 0x7f812c05d040 con 0x7f813c0af310 2024-06-11T17:18:21.278 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:18:21.281 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.282+0000 7f81419dc640 1 -- 172.21.15.130:0/132607315 >> v2:172.21.15.130:6816/3863300924 conn(0x7f8128070cd0 msgr2=0x7f8128073190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:21.281 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.282+0000 7f81419dc640 1 --2- 172.21.15.130:0/132607315 >> v2:172.21.15.130:6816/3863300924 conn(0x7f8128070cd0 0x7f8128073190 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f813c0736c0 tx=0x7f8130007df0 comp rx=0 tx=0).stop 2024-06-11T17:18:21.281 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.282+0000 7f81419dc640 1 -- 172.21.15.130:0/132607315 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f813c0af310 msgr2=0x7f813c073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:21.281 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.282+0000 7f81419dc640 1 --2- 172.21.15.130:0/132607315 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f813c0af310 0x7f813c073180 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f812c00c450 tx=0x7f812c00c910 comp rx=0 tx=0).stop 2024-06-11T17:18:21.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.282+0000 7f81419dc640 1 -- 172.21.15.130:0/132607315 shutdown_connections 2024-06-11T17:18:21.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.282+0000 7f81419dc640 1 --2- 172.21.15.130:0/132607315 >> v2:172.21.15.130:6816/3863300924 conn(0x7f8128070cd0 0x7f8128073190 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:21.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.282+0000 7f81419dc640 1 --2- 172.21.15.130:0/132607315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f813c13f800 0x7f813c146940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:21.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.282+0000 7f81419dc640 1 --2- 172.21.15.130:0/132607315 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f813c13d190 0x7f813c146400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:21.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.282+0000 7f81419dc640 1 --2- 172.21.15.130:0/132607315 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f813c0af310 0x7f813c073180 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:21.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.282+0000 7f81419dc640 1 -- 172.21.15.130:0/132607315 >> 172.21.15.130:0/132607315 conn(0x7f813c0b46b0 msgr2=0x7f813c0af940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:21.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.282+0000 7f81419dc640 1 -- 172.21.15.130:0/132607315 shutdown_connections 2024-06-11T17:18:21.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.282+0000 7f81419dc640 1 -- 172.21.15.130:0/132607315 wait complete. 2024-06-11T17:18:21.298 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":4,"flags":0,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3863300924}]},"active_addr":"172.21.15.130:6816/3863300924","active_change":"2024-06-11T17:18:12.805280+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4102,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.130:0","nonce":2582825948}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.130:0","nonce":4036314437}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.130:0","nonce":2177564201}]}]} 2024-06-11T17:18:21.304 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-06-11T17:18:21.304 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-06-11T17:18:21.304 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-11T17:18:21.422 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.422+0000 7f5403872640 1 Processor -- start 2024-06-11T17:18:21.422 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.422+0000 7f5403872640 1 -- start start 2024-06-11T17:18:21.423 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.426+0000 7f5403872640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f53fc0af310 0x7f53fc13f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:21.424 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.426+0000 7f5403872640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f53fc0ae6a0 0x7f53fc13ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:21.424 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.426+0000 7f5403872640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f53fc0aeaa0 0x7f53fc13cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:21.424 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.426+0000 7f5403872640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f53fc0af6f0 con 0x7f53fc0aeaa0 2024-06-11T17:18:21.424 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.426+0000 7f5403872640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f53fc0aca90 con 0x7f53fc0af310 2024-06-11T17:18:21.424 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.426+0000 7f5403872640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f53fc0ad920 con 0x7f53fc0ae6a0 2024-06-11T17:18:21.424 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.426+0000 7f5400e0d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f53fc0ae6a0 0x7f53fc13ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:21.424 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.426+0000 7f5400e0d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f53fc0ae6a0 0x7f53fc13ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:53464/0 (socket says 172.21.15.130:53464) 2024-06-11T17:18:21.424 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.426+0000 7f5400e0d640 1 -- 172.21.15.130:0/1699043344 learned_addr learned my addr 172.21.15.130:0/1699043344 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:21.424 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.426+0000 7f5401e0f640 1 --2- 172.21.15.130:0/1699043344 >> v2:172.21.15.130:3300/0 conn(0x7f53fc0aeaa0 0x7f53fc13cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:21.424 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.426+0000 7f540160e640 1 --2- 172.21.15.130:0/1699043344 >> v2:172.21.15.172:3300/0 conn(0x7f53fc0af310 0x7f53fc13f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:21.424 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.426+0000 7f5400e0d640 1 -- 172.21.15.130:0/1699043344 >> v2:172.21.15.172:3300/0 conn(0x7f53fc0af310 msgr2=0x7f53fc13f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:21.424 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.426+0000 7f5400e0d640 1 --2- 172.21.15.130:0/1699043344 >> v2:172.21.15.172:3300/0 conn(0x7f53fc0af310 0x7f53fc13f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:21.424 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.426+0000 7f5400e0d640 1 -- 172.21.15.130:0/1699043344 >> v2:172.21.15.130:3300/0 conn(0x7f53fc0aeaa0 msgr2=0x7f53fc13cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:21.425 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.426+0000 7f5400e0d640 1 --2- 172.21.15.130:0/1699043344 >> v2:172.21.15.130:3300/0 conn(0x7f53fc0aeaa0 0x7f53fc13cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:21.425 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.426+0000 7f5400e0d640 1 -- 172.21.15.130:0/1699043344 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53fc0adc00 con 0x7f53fc0ae6a0 2024-06-11T17:18:21.425 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.426+0000 7f5401e0f640 1 --2- 172.21.15.130:0/1699043344 >> v2:172.21.15.130:3300/0 conn(0x7f53fc0aeaa0 0x7f53fc13cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:18:21.425 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.426+0000 7f5400e0d640 1 --2- 172.21.15.130:0/1699043344 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f53fc0ae6a0 0x7f53fc13ca80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f53fc0ae0f0 tx=0x7f53ec01eb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c394fe7a474d565f server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:21.426 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.426+0000 7f53f3fff640 1 -- 172.21.15.130:0/1699043344 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ec0b4070 con 0x7f53fc0ae6a0 2024-06-11T17:18:21.426 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.426+0000 7f53f3fff640 1 -- 172.21.15.130:0/1699043344 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53ec0a7ae0 con 0x7f53fc0ae6a0 2024-06-11T17:18:21.426 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.426+0000 7f53f3fff640 1 -- 172.21.15.130:0/1699043344 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ec0af440 con 0x7f53fc0ae6a0 2024-06-11T17:18:21.427 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.426+0000 7f5403872640 1 -- 172.21.15.130:0/1699043344 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f53fc0ae6a0 msgr2=0x7f53fc13ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:21.427 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.426+0000 7f5403872640 1 --2- 172.21.15.130:0/1699043344 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f53fc0ae6a0 0x7f53fc13ca80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f53fc0ae0f0 tx=0x7f53ec01eb40 comp rx=0 tx=0).stop 2024-06-11T17:18:21.427 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.426+0000 7f5403872640 1 -- 172.21.15.130:0/1699043344 shutdown_connections 2024-06-11T17:18:21.427 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.426+0000 7f5403872640 1 --2- 172.21.15.130:0/1699043344 >> v2:172.21.15.130:3300/0 conn(0x7f53fc0aeaa0 0x7f53fc13cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:21.427 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.426+0000 7f5403872640 1 --2- 172.21.15.130:0/1699043344 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f53fc0ae6a0 0x7f53fc13ca80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:21.427 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.426+0000 7f5403872640 1 --2- 172.21.15.130:0/1699043344 >> v2:172.21.15.172:3300/0 conn(0x7f53fc0af310 0x7f53fc13f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:21.427 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.426+0000 7f5403872640 1 -- 172.21.15.130:0/1699043344 >> 172.21.15.130:0/1699043344 conn(0x7f53fc0b46b0 msgr2=0x7f53fc0b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:21.427 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.430+0000 7f5403872640 1 -- 172.21.15.130:0/1699043344 shutdown_connections 2024-06-11T17:18:21.427 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.430+0000 7f5403872640 1 -- 172.21.15.130:0/1699043344 wait complete. 2024-06-11T17:18:21.429 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.430+0000 7f5403872640 1 Processor -- start 2024-06-11T17:18:21.430 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.430+0000 7f5403872640 1 -- start start 2024-06-11T17:18:21.430 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.430+0000 7f5403872640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53fc0ae6a0 0x7f53fc148730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:21.430 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.430+0000 7f5403872640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f53fc0aeaa0 0x7f53fc070900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:21.430 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.430+0000 7f5403872640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53fc0af310 0x7f53fc1de3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:21.430 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.430+0000 7f5403872640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc143900 con 0x7f53fc0ae6a0 2024-06-11T17:18:21.430 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.430+0000 7f5403872640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc143780 con 0x7f53fc0af310 2024-06-11T17:18:21.430 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.430+0000 7f5403872640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f53fc143a80 con 0x7f53fc0aeaa0 2024-06-11T17:18:21.430 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.430+0000 7f540160e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53fc0ae6a0 0x7f53fc148730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:21.430 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.430+0000 7f5400e0d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f53fc0aeaa0 0x7f53fc070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:21.430 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.430+0000 7f540160e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53fc0ae6a0 0x7f53fc148730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38344/0 (socket says 172.21.15.130:38344) 2024-06-11T17:18:21.430 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.430+0000 7f5400e0d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f53fc0aeaa0 0x7f53fc070900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:53468/0 (socket says 172.21.15.130:53468) 2024-06-11T17:18:21.430 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.430+0000 7f540160e640 1 -- 172.21.15.130:0/1363448841 learned_addr learned my addr 172.21.15.130:0/1363448841 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:21.431 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.430+0000 7f5401e0f640 1 --2- 172.21.15.130:0/1363448841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53fc0af310 0x7f53fc1de3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:21.431 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.430+0000 7f540160e640 1 -- 172.21.15.130:0/1363448841 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f53fc0aeaa0 msgr2=0x7f53fc070900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:21.431 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.430+0000 7f540160e640 1 --2- 172.21.15.130:0/1363448841 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f53fc0aeaa0 0x7f53fc070900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:21.431 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.430+0000 7f540160e640 1 -- 172.21.15.130:0/1363448841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53fc0af310 msgr2=0x7f53fc1de3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:21.431 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.430+0000 7f540160e640 1 --2- 172.21.15.130:0/1363448841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53fc0af310 0x7f53fc1de3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:21.431 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.430+0000 7f540160e640 1 -- 172.21.15.130:0/1363448841 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53fc071a80 con 0x7f53fc0ae6a0 2024-06-11T17:18:21.431 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.430+0000 7f5400e0d640 1 --2- 172.21.15.130:0/1363448841 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f53fc0aeaa0 0x7f53fc070900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:18:21.431 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.430+0000 7f5401e0f640 1 --2- 172.21.15.130:0/1363448841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53fc0af310 0x7f53fc1de3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-11T17:18:21.431 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.430+0000 7f540160e640 1 --2- 172.21.15.130:0/1363448841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53fc0ae6a0 0x7f53fc148730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f53f800d620 tx=0x7f53f800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:21.431 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.430+0000 7f53f1ffb640 1 -- 172.21.15.130:0/1363448841 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f80125f0 con 0x7f53fc0ae6a0 2024-06-11T17:18:21.431 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.430+0000 7f53f1ffb640 1 -- 172.21.15.130:0/1363448841 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53f8019070 con 0x7f53fc0ae6a0 2024-06-11T17:18:21.431 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.430+0000 7f53f1ffb640 1 -- 172.21.15.130:0/1363448841 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f80129b0 con 0x7f53fc0ae6a0 2024-06-11T17:18:21.431 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.430+0000 7f5403872640 1 -- 172.21.15.130:0/1363448841 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53fc06fd60 con 0x7f53fc0ae6a0 2024-06-11T17:18:21.431 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.430+0000 7f5403872640 1 -- 172.21.15.130:0/1363448841 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53fc0706d0 con 0x7f53fc0ae6a0 2024-06-11T17:18:21.432 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.430+0000 7f5403872640 1 -- 172.21.15.130:0/1363448841 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53fc13f800 con 0x7f53fc0ae6a0 2024-06-11T17:18:21.432 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.434+0000 7f53f1ffb640 1 -- 172.21.15.130:0/1363448841 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 4) ==== 94213+0+0 (secure 0 0 0) 0x7f53f8012b50 con 0x7f53fc0ae6a0 2024-06-11T17:18:21.432 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.434+0000 7f53f1ffb640 1 --2- 172.21.15.130:0/1363448841 >> v2:172.21.15.130:6816/3863300924 conn(0x7f53e0070cd0 0x7f53e0073190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:21.432 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.434+0000 7f53f1ffb640 1 -- 172.21.15.130:0/1363448841 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4090+0+0 (secure 0 0 0) 0x7f53f8090af0 con 0x7f53fc0ae6a0 2024-06-11T17:18:21.432 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.434+0000 7f5400e0d640 1 --2- 172.21.15.130:0/1363448841 >> v2:172.21.15.130:6816/3863300924 conn(0x7f53e0070cd0 0x7f53e0073190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:21.433 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.434+0000 7f5400e0d640 1 --2- 172.21.15.130:0/1363448841 >> v2:172.21.15.130:6816/3863300924 conn(0x7f53e0070cd0 0x7f53e0073190 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f53ec0b1000 tx=0x7f53ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:21.436 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.438+0000 7f53f1ffb640 1 -- 172.21.15.130:0/1363448841 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7f53fc0706d0 con 0x7f53fc0ae6a0 2024-06-11T17:18:21.600 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.602+0000 7f5403872640 1 -- 172.21.15.130:0/1363448841 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f53fc0b2c80 con 0x7f53fc0ae6a0 2024-06-11T17:18:21.601 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.602+0000 7f53f1ffb640 1 -- 172.21.15.130:0/1363448841 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12779 (secure 0 0 0) 0x7f53fc06fd60 con 0x7f53fc0ae6a0 2024-06-11T17:18:21.601 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:18:21.601 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":17,"fsid":"fae1d0b0-28f2-4ebc-8a2f-59aed9de5555","created":"2024-06-11T17:18:08.122125+0000","modified":"2024-06-11T17:18:21.569520+0000","last_up_change":"2024-06-11T17:18:18.550650+0000","last_in_change":"2024-06-11T17:18:10.336508+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-11T17:18:18.850259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-06-11T17:18:19.062089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0bb385e4-fde4-44a5-a9ca-491e3a80dd65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":1675918119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":1675918119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":1675918119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":1675918119}]},"public_addr":"172.21.15.130:6800/1675918119","cluster_addr":"172.21.15.130:6801/1675918119","heartbeat_back_addr":"172.21.15.130:6803/1675918119","heartbeat_front_addr":"172.21.15.130:6802/1675918119","state":["exists","up"]},{"osd":1,"uuid":"b96b90b9-e209-41df-9235-5ee65fc63857","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":1676407705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":1676407705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":1676407705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":1676407705}]},"public_addr":"172.21.15.130:6804/1676407705","cluster_addr":"172.21.15.130:6805/1676407705","heartbeat_back_addr":"172.21.15.130:6807/1676407705","heartbeat_front_addr":"172.21.15.130:6806/1676407705","state":["exists","up"]},{"osd":2,"uuid":"4f935459-1234-4e49-86b9-0a5963e12faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":272447947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":272447947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":272447947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":272447947}]},"public_addr":"172.21.15.130:6808/272447947","cluster_addr":"172.21.15.130:6809/272447947","heartbeat_back_addr":"172.21.15.130:6813/272447947","heartbeat_front_addr":"172.21.15.130:6811/272447947","state":["exists","up"]},{"osd":3,"uuid":"e232dcd6-4ef9-4a81-a427-bf9efcccd670","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":995804279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":995804279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":995804279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":995804279}]},"public_addr":"172.21.15.130:6810/995804279","cluster_addr":"172.21.15.130:6812/995804279","heartbeat_back_addr":"172.21.15.130:6815/995804279","heartbeat_front_addr":"172.21.15.130:6814/995804279","state":["exists","up"]},{"osd":4,"uuid":"1370f2fe-be19-41e6-8476-a59ad515bd69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":1264612709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":1264612709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6815","nonce":1264612709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":1264612709}]},"public_addr":"172.21.15.172:6812/1264612709","cluster_addr":"172.21.15.172:6813/1264612709","heartbeat_back_addr":"172.21.15.172:6815/1264612709","heartbeat_front_addr":"172.21.15.172:6814/1264612709","state":["exists","up"]},{"osd":5,"uuid":"c0e83219-1ebf-4d46-83b6-3ca844bbcfe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":63774775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":63774775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":63774775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":63774775}]},"public_addr":"172.21.15.172:6800/63774775","cluster_addr":"172.21.15.172:6802/63774775","heartbeat_back_addr":"172.21.15.172:6806/63774775","heartbeat_front_addr":"172.21.15.172:6804/63774775","state":["exists","up"]},{"osd":6,"uuid":"08334a75-d052-4cb8-ae48-5908947f920f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":1734469189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":1734469189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6811","nonce":1734469189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":1734469189}]},"public_addr":"172.21.15.172:6808/1734469189","cluster_addr":"172.21.15.172:6809/1734469189","heartbeat_back_addr":"172.21.15.172:6811/1734469189","heartbeat_front_addr":"172.21.15.172:6810/1734469189","state":["exists","up"]},{"osd":7,"uuid":"ec87f14f-b324-47e4-9740-fb304bf3d963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6801","nonce":3950047248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6803","nonce":3950047248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6807","nonce":3950047248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3950047248}]},"public_addr":"172.21.15.172:6801/3950047248","cluster_addr":"172.21.15.172:6803/3950047248","heartbeat_back_addr":"172.21.15.172:6807/3950047248","heartbeat_front_addr":"172.21.15.172:6805/3950047248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T17:18:15.782617+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T17:18:15.963078+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T17:18:15.946297+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T17:18:15.983728+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T17:18:15.867646+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T17:18:15.954321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T17:18:15.940511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T17:18:15.900797+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-11T17:18:21.603 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.606+0000 7f5403872640 1 -- 172.21.15.130:0/1363448841 >> v2:172.21.15.130:6816/3863300924 conn(0x7f53e0070cd0 msgr2=0x7f53e0073190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:21.604 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.606+0000 7f5403872640 1 --2- 172.21.15.130:0/1363448841 >> v2:172.21.15.130:6816/3863300924 conn(0x7f53e0070cd0 0x7f53e0073190 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f53ec0b1000 tx=0x7f53ec008040 comp rx=0 tx=0).stop 2024-06-11T17:18:21.604 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.606+0000 7f5403872640 1 -- 172.21.15.130:0/1363448841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53fc0ae6a0 msgr2=0x7f53fc148730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:21.604 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.606+0000 7f5403872640 1 --2- 172.21.15.130:0/1363448841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53fc0ae6a0 0x7f53fc148730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f53f800d620 tx=0x7f53f800dae0 comp rx=0 tx=0).stop 2024-06-11T17:18:21.604 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.606+0000 7f5403872640 1 -- 172.21.15.130:0/1363448841 shutdown_connections 2024-06-11T17:18:21.604 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.606+0000 7f5403872640 1 --2- 172.21.15.130:0/1363448841 >> v2:172.21.15.130:6816/3863300924 conn(0x7f53e0070cd0 0x7f53e0073190 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:21.604 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.606+0000 7f5403872640 1 --2- 172.21.15.130:0/1363448841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53fc0af310 0x7f53fc1de3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:21.604 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.606+0000 7f5403872640 1 --2- 172.21.15.130:0/1363448841 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f53fc0aeaa0 0x7f53fc070900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:21.604 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.606+0000 7f5403872640 1 --2- 172.21.15.130:0/1363448841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53fc0ae6a0 0x7f53fc148730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:21.604 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.606+0000 7f5403872640 1 -- 172.21.15.130:0/1363448841 >> 172.21.15.130:0/1363448841 conn(0x7f53fc0b46b0 msgr2=0x7f53fc0b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:21.604 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.606+0000 7f5403872640 1 -- 172.21.15.130:0/1363448841 shutdown_connections 2024-06-11T17:18:21.604 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.606+0000 7f5403872640 1 -- 172.21.15.130:0/1363448841 wait complete. 2024-06-11T17:18:21.619 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-06-11T17:18:21.619 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-11T17:18:21.737 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.738+0000 7f4cb7f04640 1 Processor -- start 2024-06-11T17:18:21.738 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.738+0000 7f4cb7f04640 1 -- start start 2024-06-11T17:18:21.739 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.738+0000 7f4cb7f04640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4cb00ac280 0x7f4cb00aa690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:21.739 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.738+0000 7f4cb7f04640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4cb006c6d0 0x7f4cb0146290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:21.739 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.738+0000 7f4cb7f04640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4cb01467d0 0x7f4cb00af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:21.739 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.738+0000 7f4cb7f04640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f4cb00ac660 con 0x7f4cb01467d0 2024-06-11T17:18:21.739 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.738+0000 7f4cb7f04640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f4cb01409c0 con 0x7f4cb00ac280 2024-06-11T17:18:21.739 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.738+0000 7f4cb7f04640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4cb006c1f0 con 0x7f4cb006c6d0 2024-06-11T17:18:21.739 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.738+0000 7f4cb549f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4cb006c6d0 0x7f4cb0146290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:21.739 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.738+0000 7f4cb64a1640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4cb01467d0 0x7f4cb00af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:21.740 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.738+0000 7f4cb549f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4cb006c6d0 0x7f4cb0146290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:53480/0 (socket says 172.21.15.130:53480) 2024-06-11T17:18:21.740 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.738+0000 7f4cb549f640 1 -- 172.21.15.130:0/3055686717 learned_addr learned my addr 172.21.15.130:0/3055686717 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:21.740 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.742+0000 7f4cb5ca0640 1 --2- 172.21.15.130:0/3055686717 >> v2:172.21.15.172:3300/0 conn(0x7f4cb00ac280 0x7f4cb00aa690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:21.740 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.742+0000 7f4cb64a1640 1 -- 172.21.15.130:0/3055686717 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4cb006c6d0 msgr2=0x7f4cb0146290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:21.740 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.742+0000 7f4cb64a1640 1 --2- 172.21.15.130:0/3055686717 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4cb006c6d0 0x7f4cb0146290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:21.740 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.742+0000 7f4cb64a1640 1 -- 172.21.15.130:0/3055686717 >> v2:172.21.15.172:3300/0 conn(0x7f4cb00ac280 msgr2=0x7f4cb00aa690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:21.740 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.742+0000 7f4cb64a1640 1 --2- 172.21.15.130:0/3055686717 >> v2:172.21.15.172:3300/0 conn(0x7f4cb00ac280 0x7f4cb00aa690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:21.740 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.742+0000 7f4cb64a1640 1 -- 172.21.15.130:0/3055686717 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb00b1de0 con 0x7f4cb01467d0 2024-06-11T17:18:21.740 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.742+0000 7f4cb549f640 1 --2- 172.21.15.130:0/3055686717 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4cb006c6d0 0x7f4cb0146290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:18:21.741 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.742+0000 7f4cb64a1640 1 --2- 172.21.15.130:0/3055686717 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cb01467d0 0x7f4cb00af0b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4cb006b5f0 tx=0x7f4ca801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8eecfa1e94b59d6 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:21.741 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.742+0000 7f4cb4c9e640 1 -- 172.21.15.130:0/3055686717 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca80b2070 con 0x7f4cb01467d0 2024-06-11T17:18:21.741 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.742+0000 7f4cb4c9e640 1 -- 172.21.15.130:0/3055686717 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ca80a5920 con 0x7f4cb01467d0 2024-06-11T17:18:21.741 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.742+0000 7f4cb4c9e640 1 -- 172.21.15.130:0/3055686717 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca80a5cf0 con 0x7f4cb01467d0 2024-06-11T17:18:21.742 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.742+0000 7f4cb7f04640 1 -- 172.21.15.130:0/3055686717 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cb01467d0 msgr2=0x7f4cb00af0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:21.742 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.742+0000 7f4cb7f04640 1 --2- 172.21.15.130:0/3055686717 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cb01467d0 0x7f4cb00af0b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4cb006b5f0 tx=0x7f4ca801c880 comp rx=0 tx=0).stop 2024-06-11T17:18:21.742 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.742+0000 7f4cb7f04640 1 -- 172.21.15.130:0/3055686717 shutdown_connections 2024-06-11T17:18:21.742 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.742+0000 7f4cb7f04640 1 --2- 172.21.15.130:0/3055686717 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cb01467d0 0x7f4cb00af0b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:21.742 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.742+0000 7f4cb7f04640 1 --2- 172.21.15.130:0/3055686717 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4cb006c6d0 0x7f4cb0146290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:21.742 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.742+0000 7f4cb7f04640 1 --2- 172.21.15.130:0/3055686717 >> v2:172.21.15.172:3300/0 conn(0x7f4cb00ac280 0x7f4cb00aa690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:21.743 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.742+0000 7f4cb7f04640 1 -- 172.21.15.130:0/3055686717 >> 172.21.15.130:0/3055686717 conn(0x7f4cb006d160 msgr2=0x7f4cb006d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:21.743 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.742+0000 7f4cb7f04640 1 -- 172.21.15.130:0/3055686717 shutdown_connections 2024-06-11T17:18:21.743 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.742+0000 7f4cb7f04640 1 -- 172.21.15.130:0/3055686717 wait complete. 2024-06-11T17:18:21.745 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.746+0000 7f4cb7f04640 1 Processor -- start 2024-06-11T17:18:21.745 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.746+0000 7f4cb7f04640 1 -- start start 2024-06-11T17:18:21.745 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.746+0000 7f4cb7f04640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cb006c6d0 0x7f4cb0147c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:21.745 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.746+0000 7f4cb7f04640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4cb00ac280 0x7f4cb00731e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:21.745 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.746+0000 7f4cb7f04640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4cb01467d0 0x7f4cb00707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:21.745 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.746+0000 7f4cb7f04640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb0143910 con 0x7f4cb006c6d0 2024-06-11T17:18:21.745 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.746+0000 7f4cb7f04640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb0143790 con 0x7f4cb00ac280 2024-06-11T17:18:21.745 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.746+0000 7f4cb7f04640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4cb0143a90 con 0x7f4cb01467d0 2024-06-11T17:18:21.745 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.746+0000 7f4cb64a1640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4cb01467d0 0x7f4cb00707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:21.745 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.746+0000 7f4cb64a1640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4cb01467d0 0x7f4cb00707b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:53494/0 (socket says 172.21.15.130:53494) 2024-06-11T17:18:21.745 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.746+0000 7f4cb64a1640 1 -- 172.21.15.130:0/2177998914 learned_addr learned my addr 172.21.15.130:0/2177998914 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:21.745 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.746+0000 7f4cb5ca0640 1 --2- 172.21.15.130:0/2177998914 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cb006c6d0 0x7f4cb0147c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:21.745 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.746+0000 7f4cb549f640 1 --2- 172.21.15.130:0/2177998914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4cb00ac280 0x7f4cb00731e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:21.746 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.746+0000 7f4cb64a1640 1 -- 172.21.15.130:0/2177998914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4cb00ac280 msgr2=0x7f4cb00731e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:21.746 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.746+0000 7f4cb64a1640 1 --2- 172.21.15.130:0/2177998914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4cb00ac280 0x7f4cb00731e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:21.746 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.746+0000 7f4cb64a1640 1 -- 172.21.15.130:0/2177998914 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cb006c6d0 msgr2=0x7f4cb0147c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:21.746 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.746+0000 7f4cb64a1640 1 --2- 172.21.15.130:0/2177998914 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cb006c6d0 0x7f4cb0147c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:21.746 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.746+0000 7f4cb64a1640 1 -- 172.21.15.130:0/2177998914 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb0148e10 con 0x7f4cb01467d0 2024-06-11T17:18:21.746 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.746+0000 7f4cb5ca0640 1 --2- 172.21.15.130:0/2177998914 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cb006c6d0 0x7f4cb0147c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:18:21.746 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.746+0000 7f4cb64a1640 1 --2- 172.21.15.130:0/2177998914 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4cb01467d0 0x7f4cb00707b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4ca801af30 tx=0x7f4ca8019620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:21.746 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.746+0000 7f4ca67fc640 1 -- 172.21.15.130:0/2177998914 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca80b2050 con 0x7f4cb01467d0 2024-06-11T17:18:21.746 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.746+0000 7f4ca67fc640 1 -- 172.21.15.130:0/2177998914 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ca80be070 con 0x7f4cb01467d0 2024-06-11T17:18:21.746 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.746+0000 7f4ca67fc640 1 -- 172.21.15.130:0/2177998914 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8009450 con 0x7f4cb01467d0 2024-06-11T17:18:21.746 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.746+0000 7f4cb7f04640 1 -- 172.21.15.130:0/2177998914 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cb01490f0 con 0x7f4cb01467d0 2024-06-11T17:18:21.746 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.746+0000 7f4cb7f04640 1 -- 172.21.15.130:0/2177998914 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cb0073720 con 0x7f4cb01467d0 2024-06-11T17:18:21.747 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.746+0000 7f4cb7f04640 1 -- 172.21.15.130:0/2177998914 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cb00aa690 con 0x7f4cb01467d0 2024-06-11T17:18:21.747 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.746+0000 7f4ca67fc640 1 -- 172.21.15.130:0/2177998914 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 4) ==== 94213+0+0 (secure 0 0 0) 0x7f4ca80c3460 con 0x7f4cb01467d0 2024-06-11T17:18:21.747 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.746+0000 7f4ca67fc640 1 --2- 172.21.15.130:0/2177998914 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4c94070d00 0x7f4c940731c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:21.747 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.746+0000 7f4cb5ca0640 1 --2- 172.21.15.130:0/2177998914 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4c94070d00 0x7f4c940731c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:21.747 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.746+0000 7f4ca67fc640 1 -- 172.21.15.130:0/2177998914 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 4090+0+0 (secure 0 0 0) 0x7f4ca812c820 con 0x7f4cb01467d0 2024-06-11T17:18:21.747 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.750+0000 7f4cb5ca0640 1 --2- 172.21.15.130:0/2177998914 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4c94070d00 0x7f4c940731c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0007e50 tx=0x7f4ca0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:21.750 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.750+0000 7f4ca67fc640 1 -- 172.21.15.130:0/2177998914 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7f4ca8016500 con 0x7f4cb01467d0 2024-06-11T17:18:21.829 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.830+0000 7f4ca67fc640 1 -- 172.21.15.130:0/2177998914 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f4ca80f4630 con 0x7f4cb01467d0 2024-06-11T17:18:21.911 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.914+0000 7f4cb7f04640 1 -- 172.21.15.130:0/2177998914 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4cb0073b80 con 0x7f4cb01467d0 2024-06-11T17:18:21.912 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.914+0000 7f4ca67fc640 1 -- 172.21.15.130:0/2177998914 <== mon.2 v2:172.21.15.130:3301/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12779 (secure 0 0 0) 0x7f4ca80f93c0 con 0x7f4cb01467d0 2024-06-11T17:18:21.913 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:18:21.913 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":17,"fsid":"fae1d0b0-28f2-4ebc-8a2f-59aed9de5555","created":"2024-06-11T17:18:08.122125+0000","modified":"2024-06-11T17:18:21.569520+0000","last_up_change":"2024-06-11T17:18:18.550650+0000","last_in_change":"2024-06-11T17:18:10.336508+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-11T17:18:18.850259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-06-11T17:18:19.062089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0bb385e4-fde4-44a5-a9ca-491e3a80dd65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":1675918119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":1675918119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":1675918119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":1675918119}]},"public_addr":"172.21.15.130:6800/1675918119","cluster_addr":"172.21.15.130:6801/1675918119","heartbeat_back_addr":"172.21.15.130:6803/1675918119","heartbeat_front_addr":"172.21.15.130:6802/1675918119","state":["exists","up"]},{"osd":1,"uuid":"b96b90b9-e209-41df-9235-5ee65fc63857","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":1676407705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":1676407705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":1676407705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":1676407705}]},"public_addr":"172.21.15.130:6804/1676407705","cluster_addr":"172.21.15.130:6805/1676407705","heartbeat_back_addr":"172.21.15.130:6807/1676407705","heartbeat_front_addr":"172.21.15.130:6806/1676407705","state":["exists","up"]},{"osd":2,"uuid":"4f935459-1234-4e49-86b9-0a5963e12faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":272447947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":272447947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":272447947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":272447947}]},"public_addr":"172.21.15.130:6808/272447947","cluster_addr":"172.21.15.130:6809/272447947","heartbeat_back_addr":"172.21.15.130:6813/272447947","heartbeat_front_addr":"172.21.15.130:6811/272447947","state":["exists","up"]},{"osd":3,"uuid":"e232dcd6-4ef9-4a81-a427-bf9efcccd670","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":995804279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":995804279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":995804279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":995804279}]},"public_addr":"172.21.15.130:6810/995804279","cluster_addr":"172.21.15.130:6812/995804279","heartbeat_back_addr":"172.21.15.130:6815/995804279","heartbeat_front_addr":"172.21.15.130:6814/995804279","state":["exists","up"]},{"osd":4,"uuid":"1370f2fe-be19-41e6-8476-a59ad515bd69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":1264612709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":1264612709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6815","nonce":1264612709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":1264612709}]},"public_addr":"172.21.15.172:6812/1264612709","cluster_addr":"172.21.15.172:6813/1264612709","heartbeat_back_addr":"172.21.15.172:6815/1264612709","heartbeat_front_addr":"172.21.15.172:6814/1264612709","state":["exists","up"]},{"osd":5,"uuid":"c0e83219-1ebf-4d46-83b6-3ca844bbcfe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":63774775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":63774775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":63774775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":63774775}]},"public_addr":"172.21.15.172:6800/63774775","cluster_addr":"172.21.15.172:6802/63774775","heartbeat_back_addr":"172.21.15.172:6806/63774775","heartbeat_front_addr":"172.21.15.172:6804/63774775","state":["exists","up"]},{"osd":6,"uuid":"08334a75-d052-4cb8-ae48-5908947f920f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":1734469189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":1734469189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6811","nonce":1734469189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":1734469189}]},"public_addr":"172.21.15.172:6808/1734469189","cluster_addr":"172.21.15.172:6809/1734469189","heartbeat_back_addr":"172.21.15.172:6811/1734469189","heartbeat_front_addr":"172.21.15.172:6810/1734469189","state":["exists","up"]},{"osd":7,"uuid":"ec87f14f-b324-47e4-9740-fb304bf3d963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6801","nonce":3950047248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6803","nonce":3950047248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6807","nonce":3950047248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3950047248}]},"public_addr":"172.21.15.172:6801/3950047248","cluster_addr":"172.21.15.172:6803/3950047248","heartbeat_back_addr":"172.21.15.172:6807/3950047248","heartbeat_front_addr":"172.21.15.172:6805/3950047248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T17:18:15.782617+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T17:18:15.963078+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T17:18:15.946297+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T17:18:15.983728+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T17:18:15.867646+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T17:18:15.954321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T17:18:15.940511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T17:18:15.900797+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-11T17:18:21.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.914+0000 7f4cb7f04640 1 -- 172.21.15.130:0/2177998914 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4c94070d00 msgr2=0x7f4c940731c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:21.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.914+0000 7f4cb7f04640 1 --2- 172.21.15.130:0/2177998914 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4c94070d00 0x7f4c940731c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0007e50 tx=0x7f4ca0008040 comp rx=0 tx=0).stop 2024-06-11T17:18:21.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.918+0000 7f4cb7f04640 1 -- 172.21.15.130:0/2177998914 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4cb01467d0 msgr2=0x7f4cb00707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:21.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.918+0000 7f4cb7f04640 1 --2- 172.21.15.130:0/2177998914 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4cb01467d0 0x7f4cb00707b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4ca801af30 tx=0x7f4ca8019620 comp rx=0 tx=0).stop 2024-06-11T17:18:21.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.918+0000 7f4cb7f04640 1 -- 172.21.15.130:0/2177998914 shutdown_connections 2024-06-11T17:18:21.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.918+0000 7f4cb7f04640 1 --2- 172.21.15.130:0/2177998914 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4c94070d00 0x7f4c940731c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:21.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.918+0000 7f4cb7f04640 1 --2- 172.21.15.130:0/2177998914 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4cb01467d0 0x7f4cb00707b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:21.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.918+0000 7f4cb7f04640 1 --2- 172.21.15.130:0/2177998914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4cb00ac280 0x7f4cb00731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:21.916 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.918+0000 7f4cb7f04640 1 --2- 172.21.15.130:0/2177998914 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cb006c6d0 0x7f4cb0147c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:21.916 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.918+0000 7f4cb7f04640 1 -- 172.21.15.130:0/2177998914 >> 172.21.15.130:0/2177998914 conn(0x7f4cb006d160 msgr2=0x7f4cb006e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:21.916 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.918+0000 7f4cb7f04640 1 -- 172.21.15.130:0/2177998914 shutdown_connections 2024-06-11T17:18:21.916 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:21.918+0000 7f4cb7f04640 1 -- 172.21.15.130:0/2177998914 wait complete. 2024-06-11T17:18:21.931 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-06-11T17:18:21.931 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-06-11T17:18:21.932 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-06-11T17:18:21.932 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-06-11T17:18:21.933 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-06-11T17:18:21.933 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-06-11T17:18:21.933 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-06-11T17:18:21.934 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-06-11T17:18:22.109 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.110+0000 7f2c84f6a640 1 Processor -- start 2024-06-11T17:18:22.109 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.110+0000 7f4ecfdaf640 1 Processor -- start 2024-06-11T17:18:22.110 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.110+0000 7f2c84f6a640 1 -- start start 2024-06-11T17:18:22.110 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.110+0000 7f4ecfdaf640 1 -- start start 2024-06-11T17:18:22.110 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.110+0000 7f4ecfdaf640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ec0036910 0x7f4ec002c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.110 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.110+0000 7f4ecfdaf640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4ec00c8a90 0x7f4ec00c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.111 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.110+0000 7f4ecfdaf640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ec002ce30 con 0x7f4ec00c23d0 2024-06-11T17:18:22.111 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.110+0000 7f4ecfdaf640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f4ec0036cf0 con 0x7f4ec00c8a90 2024-06-11T17:18:22.111 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.110+0000 7f4ecfdaf640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4ec002e200 con 0x7f4ec0036910 2024-06-11T17:18:22.111 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.110+0000 7f2c84f6a640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2c7802bea0 0x7f2c7802b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.112 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.110+0000 7f2c84f6a640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2c780c11c0 0x7f2c780c1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.112 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.110+0000 7f2c84f6a640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c780c7eb0 con 0x7f2c78037110 2024-06-11T17:18:22.112 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.110+0000 7f2c84f6a640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f2c780374f0 con 0x7f2c7802bea0 2024-06-11T17:18:22.112 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.110+0000 7f2c84f6a640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f2c7802ae30 con 0x7f2c780c11c0 2024-06-11T17:18:22.112 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.110+0000 7f2c7dd9b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2c7802bea0 0x7f2c7802b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.112 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.110+0000 7f2c7dd9b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2c7802bea0 0x7f2c7802b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38370/0 (socket says 172.21.15.130:38370) 2024-06-11T17:18:22.112 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.110+0000 7f2c7dd9b640 1 -- 172.21.15.130:0/3263611464 learned_addr learned my addr 172.21.15.130:0/3263611464 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:22.112 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.110+0000 7f2c7ed9d640 1 --2- 172.21.15.130:0/3263611464 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2c780c11c0 0x7f2c780c1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.112 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7f2c7ed9d640 1 -- 172.21.15.130:0/3263611464 >> v2:172.21.15.130:3300/0 conn(0x7f2c7802bea0 msgr2=0x7f2c7802b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:22.112 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7f2c7ed9d640 1 --2- 172.21.15.130:0/3263611464 >> v2:172.21.15.130:3300/0 conn(0x7f2c7802bea0 0x7f2c7802b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.112 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7f2c7ed9d640 1 -- 172.21.15.130:0/3263611464 >> v1:172.21.15.130:6789/0 conn(0x7f2c78037110 legacy=0x7f2c780c77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.113 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.110+0000 7f4ece34c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4ec00c8a90 0x7f4ec00c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.113 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.110+0000 7f4ece34c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4ec00c8a90 0x7f4ec00c8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.130:57150/0 (socket says 172.21.15.130:57150) 2024-06-11T17:18:22.113 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.110+0000 7f4ece34c640 1 -- 172.21.15.130:0/1235969416 learned_addr learned my addr 172.21.15.130:0/1235969416 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:22.113 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7f2c7ed9d640 1 -- 172.21.15.130:0/3263611464 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c7802cee0 con 0x7f2c780c11c0 2024-06-11T17:18:22.114 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7f4ece34c640 1 -- 172.21.15.130:0/1235969416 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ec0036910 msgr2=0x7f4ec002c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:22.114 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7f4ecdb4b640 1 --2- 172.21.15.130:0/1235969416 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ec0036910 0x7f4ec002c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.114 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7f4ece34c640 1 --2- 172.21.15.130:0/1235969416 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ec0036910 0x7f4ec002c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.114 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7f4ece34c640 1 -- 172.21.15.130:0/1235969416 >> v1:172.21.15.130:6789/0 conn(0x7f4ec00c23d0 legacy=0x7f4ec00c27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.114 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7f4ece34c640 1 -- 172.21.15.130:0/1235969416 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ec002e4e0 con 0x7f4ec00c8a90 2024-06-11T17:18:22.115 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7fad897df640 1 Processor -- start 2024-06-11T17:18:22.115 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7fad897df640 1 -- start start 2024-06-11T17:18:22.115 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7fad897df640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad840738f0 0x7fad84070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.115 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7fad897df640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad84072ae0 con 0x7fad8406dad0 2024-06-11T17:18:22.115 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7fad897df640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad84072dc0 con 0x7fad84071880 2024-06-11T17:18:22.115 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7fad897df640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fad8406deb0 con 0x7fad840738f0 2024-06-11T17:18:22.115 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7fad83fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fad8406dad0 0x7fad840731e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:35350/0 (socket says 172.21.15.130:35350) 2024-06-11T17:18:22.115 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7fad83fff640 1 -- 172.21.15.130:0/4052628718 learned_addr learned my addr 172.21.15.130:0/4052628718 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-06-11T17:18:22.115 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7f4ecdb4b640 1 --2- 172.21.15.130:0/1235969416 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ec0036910 0x7f4ec002c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-11T17:18:22.116 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7fad88fde640 1 --2- 172.21.15.130:0/4052628718 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad840738f0 0x7fad84070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.116 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7fad82ffd640 1 -- 172.21.15.130:0/4052628718 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1685441642 0 0) 0x7fad84072ae0 con 0x7fad8406dad0 2024-06-11T17:18:22.116 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7fad82ffd640 1 -- 172.21.15.130:0/4052628718 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad6c003530 con 0x7fad8406dad0 2024-06-11T17:18:22.116 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7fad82ffd640 1 -- 172.21.15.130:0/4052628718 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3907819111 0 0) 0x7fad84072dc0 con 0x7fad84071880 2024-06-11T17:18:22.116 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7fad82ffd640 1 -- 172.21.15.130:0/4052628718 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad84072ae0 con 0x7fad84071880 2024-06-11T17:18:22.117 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7f2d8b7b5640 1 Processor -- start 2024-06-11T17:18:22.117 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7f2c7ed9d640 1 --2- 172.21.15.130:0/3263611464 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2c780c11c0 0x7f2c780c1630 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2c80069ff0 tx=0x7f2c80098470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74805bccdc163001 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.117 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7f6200b73640 1 Processor -- start 2024-06-11T17:18:22.118 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7f2c7d59a640 1 -- 172.21.15.130:0/3263611464 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8012c070 con 0x7f2c780c11c0 2024-06-11T17:18:22.118 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7f2c7d59a640 1 -- 172.21.15.130:0/3263611464 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c80127640 con 0x7f2c780c11c0 2024-06-11T17:18:22.118 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7f2c7d59a640 1 -- 172.21.15.130:0/3263611464 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c80127ab0 con 0x7f2c780c11c0 2024-06-11T17:18:22.118 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7f6200b73640 1 -- start start 2024-06-11T17:18:22.119 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7f2d8b7b5640 1 -- start start 2024-06-11T17:18:22.119 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7f77924af640 1 Processor -- start 2024-06-11T17:18:22.119 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7fad88fde640 1 -- 172.21.15.130:0/4052628718 >> v1:172.21.15.172:6789/0 conn(0x7fad84071880 legacy=0x7fad8413c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.119 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7fad88fde640 1 -- 172.21.15.130:0/4052628718 >> v1:172.21.15.130:6789/0 conn(0x7fad8406dad0 legacy=0x7fad840731e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.119 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.114+0000 7fad88fde640 1 -- 172.21.15.130:0/4052628718 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad84071360 con 0x7fad840738f0 2024-06-11T17:18:22.120 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f4ece34c640 1 --2- 172.21.15.130:0/1235969416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ec00c8a90 0x7f4ec00c8f00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8075580 tx=0x7f4ec80985a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6aa5f04fbe1cf01 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.120 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f6200b73640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f61fc0aaef0 0x7f61fc0aa690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.120 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f6200b73640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f61fc143fe0 0x7f61fc144430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.120 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f6200b73640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61fc0ac8f0 con 0x7f61fc0aefb0 2024-06-11T17:18:22.120 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f6200b73640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f61fc0ab2d0 con 0x7f61fc143fe0 2024-06-11T17:18:22.120 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f6200b73640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f61fc144970 con 0x7f61fc0aaef0 2024-06-11T17:18:22.120 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f61fbfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f61fc143fe0 0x7f61fc144430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.120 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f61fbfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f61fc143fe0 0x7f61fc144430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.130:57154/0 (socket says 172.21.15.130:57154) 2024-06-11T17:18:22.120 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f61fbfff640 1 -- 172.21.15.130:0/206955128 learned_addr learned my addr 172.21.15.130:0/206955128 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:22.120 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f61fb7fe640 1 --2- 172.21.15.130:0/206955128 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f61fc0aaef0 0x7f61fc0aa690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.121 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f2d8b7b5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2d7c035770 0x7f2d7c0cab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.121 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f2d8b7b5640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d7c035b70 con 0x7f2d7c0cb070 2024-06-11T17:18:22.121 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f2d8b7b5640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d7c0371f0 con 0x7f2d7c039210 2024-06-11T17:18:22.121 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f2d8b7b5640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f2d7c0395f0 con 0x7f2d7c035770 2024-06-11T17:18:22.121 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f2d89d52640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f2d7c0cb070 0x7f2d7c0d1e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:35360/0 (socket says 172.21.15.130:35360) 2024-06-11T17:18:22.121 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f2d89d52640 1 -- 172.21.15.130:0/2187086412 learned_addr learned my addr 172.21.15.130:0/2187086412 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-06-11T17:18:22.122 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f77924af640 1 -- start start 2024-06-11T17:18:22.122 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f2c84f6a640 1 -- 172.21.15.130:0/3263611464 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2c780c11c0 msgr2=0x7f2c780c1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.122 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f2c84f6a640 1 --2- 172.21.15.130:0/3263611464 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2c780c11c0 0x7f2c780c1630 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2c80069ff0 tx=0x7f2c80098470 comp rx=0 tx=0).stop 2024-06-11T17:18:22.122 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f2c84f6a640 1 -- 172.21.15.130:0/3263611464 shutdown_connections 2024-06-11T17:18:22.122 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f2c84f6a640 1 --2- 172.21.15.130:0/3263611464 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2c780c11c0 0x7f2c780c1630 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.122 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f2c84f6a640 1 --2- 172.21.15.130:0/3263611464 >> v2:172.21.15.130:3300/0 conn(0x7f2c7802bea0 0x7f2c7802b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.122 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f2c84f6a640 1 -- 172.21.15.130:0/3263611464 >> 172.21.15.130:0/3263611464 conn(0x7f2c7803a400 msgr2=0x7f2c78036690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:22.123 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f4eccb49640 1 -- 172.21.15.130:0/1235969416 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec812d070 con 0x7f4ec00c8a90 2024-06-11T17:18:22.123 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f77924af640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7784007c70 0x7f778402ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.123 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f77924af640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f77840cbb30 0x7f77840cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.123 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f77924af640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77840c9370 con 0x7f778402a1a0 2024-06-11T17:18:22.123 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f77924af640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f7784008050 con 0x7f77840cbb30 2024-06-11T17:18:22.123 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f77924af640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f778402c300 con 0x7f7784007c70 2024-06-11T17:18:22.123 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f2c84f6a640 1 -- 172.21.15.130:0/3263611464 shutdown_connections 2024-06-11T17:18:22.124 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f2d88d50640 1 --2- 172.21.15.130:0/2187086412 >> v2:172.21.15.172:3300/0 conn(0x7f2d7c035770 0x7f2d7c0cab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.124 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f2d7bfff640 1 -- 172.21.15.130:0/2187086412 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1699122897 0 0) 0x7f2d7c035b70 con 0x7f2d7c0cb070 2024-06-11T17:18:22.124 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f7790a4c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f77840cbb30 0x7f77840cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.124 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f2d7bfff640 1 -- 172.21.15.130:0/2187086412 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d70003530 con 0x7f2d7c0cb070 2024-06-11T17:18:22.125 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f7790a4c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f77840cbb30 0x7f77840cbfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38374/0 (socket says 172.21.15.130:38374) 2024-06-11T17:18:22.125 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f7790a4c640 1 -- 172.21.15.130:0/1328431788 learned_addr learned my addr 172.21.15.130:0/1328431788 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:22.125 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f61fbfff640 1 -- 172.21.15.130:0/206955128 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f61fc0aaef0 msgr2=0x7f61fc0aa690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:22.125 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f61fbfff640 1 --2- 172.21.15.130:0/206955128 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f61fc0aaef0 0x7f61fc0aa690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.125 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f61fbfff640 1 -- 172.21.15.130:0/206955128 >> v1:172.21.15.172:6789/0 conn(0x7f61fc0aefb0 legacy=0x7f61fc147610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.126 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f61fbfff640 1 -- 172.21.15.130:0/206955128 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61fc1470f0 con 0x7f61fc143fe0 2024-06-11T17:18:22.126 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f778bfff640 1 --2- 172.21.15.130:0/1328431788 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7784007c70 0x7f778402ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.126 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f2d7bfff640 1 -- 172.21.15.130:0/2187086412 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4118457609 0 0) 0x7f2d7c0371f0 con 0x7f2d7c039210 2024-06-11T17:18:22.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f7790a4c640 1 -- 172.21.15.130:0/1328431788 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7784007c70 msgr2=0x7f778402ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:22.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f7790a4c640 1 --2- 172.21.15.130:0/1328431788 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7784007c70 0x7f778402ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f7790a4c640 1 -- 172.21.15.130:0/1328431788 >> v1:172.21.15.172:6789/0 conn(0x7f778402a1a0 legacy=0x7f77840c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f7790a4c640 1 -- 172.21.15.130:0/1328431788 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77840cc520 con 0x7f77840cbb30 2024-06-11T17:18:22.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f778bfff640 1 --2- 172.21.15.130:0/1328431788 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7784007c70 0x7f778402ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:18:22.129 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f2c84f6a640 1 -- 172.21.15.130:0/3263611464 wait complete. 2024-06-11T17:18:22.129 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f4eccb49640 1 -- 172.21.15.130:0/1235969416 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ec8128640 con 0x7f4ec00c8a90 2024-06-11T17:18:22.129 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f4eccb49640 1 -- 172.21.15.130:0/1235969416 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec8128ab0 con 0x7f4ec00c8a90 2024-06-11T17:18:22.130 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f4ecfdaf640 1 -- 172.21.15.130:0/1235969416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ec00c8a90 msgr2=0x7f4ec00c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.130 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f4ecfdaf640 1 --2- 172.21.15.130:0/1235969416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ec00c8a90 0x7f4ec00c8f00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8075580 tx=0x7f4ec80985a0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.130 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f2d7bfff640 1 -- 172.21.15.130:0/2187086412 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d7c035b70 con 0x7f2d7c039210 2024-06-11T17:18:22.130 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f2d7bfff640 1 -- 172.21.15.130:0/2187086412 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2421080865 0 0) 0x7f2d70003530 con 0x7f2d7c0cb070 2024-06-11T17:18:22.130 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f2d7bfff640 1 -- 172.21.15.130:0/2187086412 >> v2:172.21.15.172:3300/0 conn(0x7f2d7c035770 msgr2=0x7f2d7c0cab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:22.130 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f2d7bfff640 1 --2- 172.21.15.130:0/2187086412 >> v2:172.21.15.172:3300/0 conn(0x7f2d7c035770 0x7f2d7c0cab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.130 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f2d7bfff640 1 -- 172.21.15.130:0/2187086412 >> v1:172.21.15.172:6789/0 conn(0x7f2d7c039210 legacy=0x7f2d7c0c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.131 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f4ecfdaf640 1 -- 172.21.15.130:0/1235969416 shutdown_connections 2024-06-11T17:18:22.131 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f4ecfdaf640 1 --2- 172.21.15.130:0/1235969416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ec00c8a90 0x7f4ec00c8f00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.131 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f4ecfdaf640 1 --2- 172.21.15.130:0/1235969416 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ec0036910 0x7f4ec002c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.131 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f4ecfdaf640 1 -- 172.21.15.130:0/1235969416 >> 172.21.15.130:0/1235969416 conn(0x7f4ec0005d80 msgr2=0x7f4ec0006160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:22.131 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f2d7bfff640 1 -- 172.21.15.130:0/2187086412 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d7c035e40 con 0x7f2d7c0cb070 2024-06-11T17:18:22.131 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f4ecfdaf640 1 -- 172.21.15.130:0/1235969416 shutdown_connections 2024-06-11T17:18:22.132 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f7baf59e640 1 Processor -- start 2024-06-11T17:18:22.132 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f2d7bfff640 1 -- 172.21.15.130:0/2187086412 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3158545239 0 0) 0x7f2d8406a2b0 con 0x7f2d7c0cb070 2024-06-11T17:18:22.132 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f2c84f6a640 1 Processor -- start 2024-06-11T17:18:22.132 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f2c84f6a640 1 -- start start 2024-06-11T17:18:22.132 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f2c84f6a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c7802bea0 0x7f2c780c4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.132 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f2c84f6a640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2c78037110 0x7f2c780cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.133 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f2c84f6a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c780c11c0 0x7f2c780cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.133 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f2c84f6a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2c78006fc0 con 0x7f2c7802bea0 2024-06-11T17:18:22.133 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f2c84f6a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2c78006e40 con 0x7f2c780c11c0 2024-06-11T17:18:22.133 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f2c84f6a640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f2c78007140 con 0x7f2c78037110 2024-06-11T17:18:22.133 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f2c7dd9b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2c78037110 0x7f2c780cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.133 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f2c7dd9b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2c78037110 0x7f2c780cacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:53546/0 (socket says 172.21.15.130:53546) 2024-06-11T17:18:22.133 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f2c7dd9b640 1 -- 172.21.15.130:0/3006106158 learned_addr learned my addr 172.21.15.130:0/3006106158 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:22.133 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f2c7ed9d640 1 --2- 172.21.15.130:0/3006106158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c780c11c0 0x7f2c780cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.133 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f2c7e59c640 1 --2- 172.21.15.130:0/3006106158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c7802bea0 0x7f2c780c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.133 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f2c7dd9b640 1 -- 172.21.15.130:0/3006106158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c780c11c0 msgr2=0x7f2c780cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.133 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f2c7dd9b640 1 --2- 172.21.15.130:0/3006106158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c780c11c0 0x7f2c780cb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.133 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f2c7dd9b640 1 -- 172.21.15.130:0/3006106158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c7802bea0 msgr2=0x7f2c780c4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.133 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f2c7dd9b640 1 --2- 172.21.15.130:0/3006106158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c7802bea0 0x7f2c780c4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.134 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7fad88fde640 1 --2- 172.21.15.130:0/4052628718 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad840738f0 0x7fad84070a70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fad740097f0 tx=0x7fad74020620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f294ffbeddf4752d server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.134 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7fad82ffd640 1 -- 172.21.15.130:0/4052628718 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad740b4070 con 0x7fad840738f0 2024-06-11T17:18:22.134 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7fad82ffd640 1 -- 172.21.15.130:0/4052628718 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad740af400 con 0x7fad840738f0 2024-06-11T17:18:22.134 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7fad82ffd640 1 -- 172.21.15.130:0/4052628718 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad78001700 con 0x7fad840738f0 2024-06-11T17:18:22.134 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7fad897df640 1 -- 172.21.15.130:0/4052628718 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad840738f0 msgr2=0x7fad84070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.134 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7fad897df640 1 --2- 172.21.15.130:0/4052628718 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad840738f0 0x7fad84070a70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fad740097f0 tx=0x7fad74020620 comp rx=0 tx=0).stop 2024-06-11T17:18:22.134 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7fad897df640 1 -- 172.21.15.130:0/4052628718 shutdown_connections 2024-06-11T17:18:22.134 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7fad897df640 1 --2- 172.21.15.130:0/4052628718 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad840738f0 0x7fad84070a70 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.134 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7fad897df640 1 -- 172.21.15.130:0/4052628718 >> 172.21.15.130:0/4052628718 conn(0x7fad840b2650 msgr2=0x7fad8406d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:22.134 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7fad897df640 1 -- 172.21.15.130:0/4052628718 shutdown_connections 2024-06-11T17:18:22.135 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f7baf59e640 1 -- start start 2024-06-11T17:18:22.135 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f7baf59e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7bb0147650 0x7f7bb00ab230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.135 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f7baf59e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bb0147ae0 con 0x7f7bb00aae50 2024-06-11T17:18:22.135 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f7baf59e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bb00ae9d0 con 0x7f7bb0072e70 2024-06-11T17:18:22.135 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f7baf59e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f7bb00ab770 con 0x7f7bb0147650 2024-06-11T17:18:22.135 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f7bae59c640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f7bb00aae50 0x7f7bb00ae2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:35372/0 (socket says 172.21.15.130:35372) 2024-06-11T17:18:22.135 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f7bae59c640 1 -- 172.21.15.130:0/2508140991 learned_addr learned my addr 172.21.15.130:0/2508140991 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-06-11T17:18:22.135 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f7bad59a640 1 -- 172.21.15.130:0/2508140991 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2519636622 0 0) 0x7f7ba80014a0 con 0x7f7bb00aae50 2024-06-11T17:18:22.135 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f7baed9d640 1 --2- 172.21.15.130:0/2508140991 >> v2:172.21.15.130:3300/0 conn(0x7f7bb0147650 0x7f7bb00ab230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.136 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f7bad59a640 1 -- 172.21.15.130:0/2508140991 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b98003530 con 0x7f7bb00aae50 2024-06-11T17:18:22.136 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f4ecfdaf640 1 -- 172.21.15.130:0/1235969416 wait complete. 2024-06-11T17:18:22.136 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f4ecfdaf640 1 Processor -- start 2024-06-11T17:18:22.136 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f4ecfdaf640 1 -- start start 2024-06-11T17:18:22.136 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f4ecfdaf640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ec0036910 0x7f4ec00ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.136 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f4ecfdaf640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ec00c23d0 0x7f4ec01631e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.136 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f4ecfdaf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ec00c8a90 0x7f4ec0163720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.136 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f61fbfff640 1 --2- 172.21.15.130:0/206955128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61fc143fe0 0x7f61fc144430 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f61ec009870 tx=0x7f61ec01c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abe663cd95adbf6b server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.137 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f61fa7fc640 1 -- 172.21.15.130:0/206955128 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ec0aa430 con 0x7f61fc143fe0 2024-06-11T17:18:22.137 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f2d7bfff640 1 -- 172.21.15.130:0/2187086412 >> v1:172.21.15.130:6789/0 conn(0x7f2d7c0cb070 legacy=0x7f2d7c0d1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.137 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f2d7bfff640 1 --2- 172.21.15.130:0/2187086412 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d70003bd0 0x7f2d70003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.137 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f2d7bfff640 1 --2- 172.21.15.130:0/2187086412 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d70004810 0x7f2d70004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.137 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f2d7bfff640 1 --2- 172.21.15.130:0/2187086412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d700051d0 0x7f2d7000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.137 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f2d7bfff640 1 -- 172.21.15.130:0/2187086412 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7000bfc0 con 0x7f2d70004810 2024-06-11T17:18:22.137 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f2d7bfff640 1 -- 172.21.15.130:0/2187086412 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7000c140 con 0x7f2d700051d0 2024-06-11T17:18:22.137 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.118+0000 7f2d7bfff640 1 -- 172.21.15.130:0/2187086412 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f2d7000c340 con 0x7f2d70003bd0 2024-06-11T17:18:22.137 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f2d89551640 1 --2- 172.21.15.130:0/2187086412 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d70003bd0 0x7f2d70003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.137 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f2d89d52640 1 --2- 172.21.15.130:0/2187086412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d700051d0 0x7f2d7000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.137 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f2d88d50640 1 --2- 172.21.15.130:0/2187086412 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d70004810 0x7f2d70004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.138 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f2c7dd9b640 1 -- 172.21.15.130:0/3006106158 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c780cc600 con 0x7f2c78037110 2024-06-11T17:18:22.138 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f61fa7fc640 1 -- 172.21.15.130:0/206955128 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61ec0af070 con 0x7f61fc143fe0 2024-06-11T17:18:22.138 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f2c7ed9d640 1 --2- 172.21.15.130:0/3006106158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c780c11c0 0x7f2c780cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-11T17:18:22.138 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f2c7e59c640 1 --2- 172.21.15.130:0/3006106158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c7802bea0 0x7f2c780c4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-11T17:18:22.139 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f4ecfdaf640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec00d0780 con 0x7f4ec00c23d0 2024-06-11T17:18:22.139 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f4ecfdaf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec00d0600 con 0x7f4ec00c8a90 2024-06-11T17:18:22.139 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f4ecfdaf640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4ec00d0900 con 0x7f4ec0036910 2024-06-11T17:18:22.139 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f4ecdb4b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ec0036910 0x7f4ec00ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.139 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f4ecdb4b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ec0036910 0x7f4ec00ccc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:53558/0 (socket says 172.21.15.130:53558) 2024-06-11T17:18:22.139 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f4ecdb4b640 1 -- 172.21.15.130:0/2344297781 learned_addr learned my addr 172.21.15.130:0/2344297781 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:22.139 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7fad897df640 1 -- 172.21.15.130:0/4052628718 wait complete. 2024-06-11T17:18:22.140 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f4ecdb4b640 1 -- 172.21.15.130:0/2344297781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ec00c8a90 msgr2=0x7f4ec0163720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-11T17:18:22.140 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f4ecdb4b640 1 --2- 172.21.15.130:0/2344297781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ec00c8a90 0x7f4ec0163720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.140 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f4ecdb4b640 1 -- 172.21.15.130:0/2344297781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ec00c23d0 msgr2=0x7f4ec01631e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.140 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f4ecdb4b640 1 --2- 172.21.15.130:0/2344297781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ec00c23d0 0x7f4ec01631e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.140 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f4ecdb4b640 1 -- 172.21.15.130:0/2344297781 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ec00ce6c0 con 0x7f4ec0036910 2024-06-11T17:18:22.140 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f6200b73640 1 -- 172.21.15.130:0/206955128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61fc143fe0 msgr2=0x7f61fc144430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.140 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f6200b73640 1 --2- 172.21.15.130:0/206955128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61fc143fe0 0x7f61fc144430 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f61ec009870 tx=0x7f61ec01c4b0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.141 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7fad897df640 1 Processor -- start 2024-06-11T17:18:22.141 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f4ecdb4b640 1 --2- 172.21.15.130:0/2344297781 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ec0036910 0x7f4ec00ccc80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4eb800c7c0 tx=0x7f4eb800cc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.141 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f6200b73640 1 -- 172.21.15.130:0/206955128 shutdown_connections 2024-06-11T17:18:22.141 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f6200b73640 1 --2- 172.21.15.130:0/206955128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61fc143fe0 0x7f61fc144430 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.141 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f6200b73640 1 --2- 172.21.15.130:0/206955128 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f61fc0aaef0 0x7f61fc0aa690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.141 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f6200b73640 1 -- 172.21.15.130:0/206955128 >> 172.21.15.130:0/206955128 conn(0x7f61fc06c6b0 msgr2=0x7f61fc0b45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:22.142 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7fad897df640 1 -- start start 2024-06-11T17:18:22.142 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f6200b73640 1 -- 172.21.15.130:0/206955128 shutdown_connections 2024-06-11T17:18:22.142 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f7baed9d640 1 -- 172.21.15.130:0/2508140991 >> v1:172.21.15.172:6789/0 conn(0x7f7bb0072e70 legacy=0x7f7bb0146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.142 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f7baed9d640 1 -- 172.21.15.130:0/2508140991 >> v1:172.21.15.130:6789/0 conn(0x7f7bb00aae50 legacy=0x7f7bb00ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.143 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f7baed9d640 1 -- 172.21.15.130:0/2508140991 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bb01547a0 con 0x7f7bb0147650 2024-06-11T17:18:22.143 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f4ebe7fc640 1 -- 172.21.15.130:0/2344297781 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8007a30 con 0x7f4ec0036910 2024-06-11T17:18:22.143 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f4ebe7fc640 1 -- 172.21.15.130:0/2344297781 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4eb8007bd0 con 0x7f4ec0036910 2024-06-11T17:18:22.143 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f4ebe7fc640 1 -- 172.21.15.130:0/2344297781 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb80113f0 con 0x7f4ec0036910 2024-06-11T17:18:22.143 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f2c7dd9b640 1 --2- 172.21.15.130:0/3006106158 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2c78037110 0x7f2c780cacb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2c7000e810 tx=0x7f2c7000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.143 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f2c6effd640 1 -- 172.21.15.130:0/3006106158 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c70017070 con 0x7f2c78037110 2024-06-11T17:18:22.143 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f2c6effd640 1 -- 172.21.15.130:0/3006106158 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c7000c670 con 0x7f2c78037110 2024-06-11T17:18:22.143 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f2c6effd640 1 -- 172.21.15.130:0/3006106158 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7000f040 con 0x7f2c78037110 2024-06-11T17:18:22.144 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f2c84f6a640 1 -- 172.21.15.130:0/3006106158 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c780cc8e0 con 0x7f2c78037110 2024-06-11T17:18:22.144 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f2c84f6a640 1 -- 172.21.15.130:0/3006106158 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c780cb730 con 0x7f2c78037110 2024-06-11T17:18:22.144 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7fad897df640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad8406dad0 0x7fad8413daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.144 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7fad897df640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad840738f0 0x7fad84131630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.144 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7fad897df640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad841402c0 0x7fad84131b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.144 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f2d89551640 1 -- 172.21.15.130:0/2187086412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d700051d0 msgr2=0x7f2d7000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:22.144 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f2d89551640 1 --2- 172.21.15.130:0/2187086412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d700051d0 0x7f2d7000b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.144 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f2d89551640 1 -- 172.21.15.130:0/2187086412 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d70004810 msgr2=0x7f2d70004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:22.144 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f2d89551640 1 --2- 172.21.15.130:0/2187086412 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d70004810 0x7f2d70004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.144 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f2d89551640 1 -- 172.21.15.130:0/2187086412 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d70003530 con 0x7f2d70003bd0 2024-06-11T17:18:22.145 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f2d89d52640 1 -- 172.21.15.130:0/2187086412 reap_dead start 2024-06-11T17:18:22.145 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7fad897df640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fad8406cbf0 con 0x7fad8406dad0 2024-06-11T17:18:22.145 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7fad897df640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fad8406ca70 con 0x7fad841402c0 2024-06-11T17:18:22.145 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7fad897df640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fad8406cd70 con 0x7fad840738f0 2024-06-11T17:18:22.145 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7fad83fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad8406dad0 0x7fad8413daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.145 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7fad83fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad8406dad0 0x7fad8413daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38398/0 (socket says 172.21.15.130:38398) 2024-06-11T17:18:22.145 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7fad83fff640 1 -- 172.21.15.130:0/2483332654 learned_addr learned my addr 172.21.15.130:0/2483332654 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:22.145 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7fad837fe640 1 --2- 172.21.15.130:0/2483332654 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad840738f0 0x7fad84131630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.146 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f2d89551640 1 --2- 172.21.15.130:0/2187086412 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d70003bd0 0x7f2d70003fb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2d740018d0 tx=0x7f2d7401c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fc628dd9631cc6b server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.146 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7fad88fde640 1 --2- 172.21.15.130:0/2483332654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad841402c0 0x7fad84131b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.146 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7fad837fe640 1 -- 172.21.15.130:0/2483332654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad841402c0 msgr2=0x7fad84131b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.146 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7fad837fe640 1 --2- 172.21.15.130:0/2483332654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad841402c0 0x7fad84131b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.146 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7fad837fe640 1 -- 172.21.15.130:0/2483332654 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad8406dad0 msgr2=0x7fad8413daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.146 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7fad837fe640 1 --2- 172.21.15.130:0/2483332654 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad8406dad0 0x7fad8413daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.146 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7fad837fe640 1 -- 172.21.15.130:0/2483332654 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad8413fbc0 con 0x7fad840738f0 2024-06-11T17:18:22.147 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f4ecfdaf640 1 -- 172.21.15.130:0/2344297781 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ec0162cc0 con 0x7f4ec0036910 2024-06-11T17:18:22.147 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f4ecfdaf640 1 -- 172.21.15.130:0/2344297781 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ec00cd1c0 con 0x7f4ec0036910 2024-06-11T17:18:22.147 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f6200b73640 1 -- 172.21.15.130:0/206955128 wait complete. 2024-06-11T17:18:22.147 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f6200b73640 1 Processor -- start 2024-06-11T17:18:22.148 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.122+0000 7f7790a4c640 1 --2- 172.21.15.130:0/1328431788 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77840cbb30 0x7f77840cbfe0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f778c075580 tx=0x7f778c098610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78daa9b1d40ce7aa server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.148 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f778affd640 1 -- 172.21.15.130:0/1328431788 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c12c070 con 0x7f77840cbb30 2024-06-11T17:18:22.148 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f778affd640 1 -- 172.21.15.130:0/1328431788 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f778c127640 con 0x7f77840cbb30 2024-06-11T17:18:22.148 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f778affd640 1 -- 172.21.15.130:0/1328431788 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c127ab0 con 0x7f77840cbb30 2024-06-11T17:18:22.148 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f2c6effd640 1 -- 172.21.15.130:0/3006106158 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f2c7001a070 con 0x7f2c78037110 2024-06-11T17:18:22.148 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f2c6effd640 1 --2- 172.21.15.130:0/3006106158 >> v2:172.21.15.130:6816/3863300924 conn(0x7f2c60070e30 0x7f2c600732f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.148 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f2c6effd640 1 -- 172.21.15.130:0/3006106158 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 4090+0+0 (secure 0 0 0) 0x7f2c700905c0 con 0x7f2c78037110 2024-06-11T17:18:22.148 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f2c7e59c640 1 --2- 172.21.15.130:0/3006106158 >> v2:172.21.15.130:6816/3863300924 conn(0x7f2c60070e30 0x7f2c600732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f2d7bfff640 1 -- 172.21.15.130:0/2187086412 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d740014c0 con 0x7f2d70003bd0 2024-06-11T17:18:22.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f2d7bfff640 1 -- 172.21.15.130:0/2187086412 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d740052d0 con 0x7f2d70003bd0 2024-06-11T17:18:22.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f2d7bfff640 1 -- 172.21.15.130:0/2187086412 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d74003840 con 0x7f2d70003bd0 2024-06-11T17:18:22.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f6200b73640 1 -- start start 2024-06-11T17:18:22.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f6200b73640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61fc0aaef0 0x7f61fc0734b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f6200b73640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f61fc0aefb0 0x7f61fc0706a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f6200b73640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61fc070be0 0x7f61fc1eaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.150 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f6200b73640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc1542b0 con 0x7f61fc0aaef0 2024-06-11T17:18:22.150 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f6200b73640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc154130 con 0x7f61fc070be0 2024-06-11T17:18:22.150 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f6200b73640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f61fc154430 con 0x7f61fc0aefb0 2024-06-11T17:18:22.150 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f7baed9d640 1 --2- 172.21.15.130:0/2508140991 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb0147650 0x7f7bb00ab230 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7ba00097c0 tx=0x7f7ba001c250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f243ea3ecbb60b server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.150 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f77924af640 1 -- 172.21.15.130:0/1328431788 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77840cbb30 msgr2=0x7f77840cbfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.150 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f77924af640 1 --2- 172.21.15.130:0/1328431788 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77840cbb30 0x7f77840cbfe0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f778c075580 tx=0x7f778c098610 comp rx=0 tx=0).stop 2024-06-11T17:18:22.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7fad837fe640 1 --2- 172.21.15.130:0/2483332654 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad840738f0 0x7fad84131630 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fad7c00c7a0 tx=0x7fad7c00cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7fad80ff9640 1 -- 172.21.15.130:0/2483332654 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7c003db0 con 0x7fad840738f0 2024-06-11T17:18:22.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7fad80ff9640 1 -- 172.21.15.130:0/2483332654 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad7c005070 con 0x7fad840738f0 2024-06-11T17:18:22.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7fad80ff9640 1 -- 172.21.15.130:0/2483332654 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7c005460 con 0x7fad840738f0 2024-06-11T17:18:22.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f2c7e59c640 1 --2- 172.21.15.130:0/3006106158 >> v2:172.21.15.130:6816/3863300924 conn(0x7f2c60070e30 0x7f2c600732f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2c74001750 tx=0x7f2c74009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7fad897df640 1 -- 172.21.15.130:0/2483332654 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad8413fea0 con 0x7fad840738f0 2024-06-11T17:18:22.152 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7fad897df640 1 -- 172.21.15.130:0/2483332654 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fad8413d540 con 0x7fad840738f0 2024-06-11T17:18:22.152 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f7bad59a640 1 -- 172.21.15.130:0/2508140991 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba00b0070 con 0x7f7bb0147650 2024-06-11T17:18:22.152 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f7bad59a640 1 -- 172.21.15.130:0/2508140991 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ba00ab400 con 0x7f7bb0147650 2024-06-11T17:18:22.152 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f7bad59a640 1 -- 172.21.15.130:0/2508140991 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8001c50 con 0x7f7bb0147650 2024-06-11T17:18:22.152 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f61faffd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f61fc0aefb0 0x7f61fc0706a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.152 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f61faffd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f61fc0aefb0 0x7f61fc0706a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:53568/0 (socket says 172.21.15.130:53568) 2024-06-11T17:18:22.152 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f61faffd640 1 -- 172.21.15.130:0/2994296010 learned_addr learned my addr 172.21.15.130:0/2994296010 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:22.153 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f61fbfff640 1 --2- 172.21.15.130:0/2994296010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61fc070be0 0x7f61fc1eaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.153 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f61faffd640 1 -- 172.21.15.130:0/2994296010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61fc070be0 msgr2=0x7f61fc1eaaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.153 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f61faffd640 1 --2- 172.21.15.130:0/2994296010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61fc070be0 0x7f61fc1eaaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.153 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f61faffd640 1 -- 172.21.15.130:0/2994296010 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61fc0aaef0 msgr2=0x7f61fc0734b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.153 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f61faffd640 1 --2- 172.21.15.130:0/2994296010 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61fc0aaef0 0x7f61fc0734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.153 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f61faffd640 1 -- 172.21.15.130:0/2994296010 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61fc14c250 con 0x7f61fc0aefb0 2024-06-11T17:18:22.153 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f61fbfff640 1 --2- 172.21.15.130:0/2994296010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61fc070be0 0x7f61fc1eaaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-11T17:18:22.153 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f2d8b7b5640 1 -- 172.21.15.130:0/2187086412 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d70003bd0 msgr2=0x7f2d70003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.153 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f2d8b7b5640 1 --2- 172.21.15.130:0/2187086412 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d70003bd0 0x7f2d70003fb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2d740018d0 tx=0x7f2d7401c420 comp rx=0 tx=0).stop 2024-06-11T17:18:22.153 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f2d8b7b5640 1 -- 172.21.15.130:0/2187086412 shutdown_connections 2024-06-11T17:18:22.153 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f2d8b7b5640 1 --2- 172.21.15.130:0/2187086412 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d70003bd0 0x7f2d70003fb0 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2d740018d0 tx=0x7f2d7401c420 comp rx=0 tx=0).stop 2024-06-11T17:18:22.154 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f2d8b7b5640 1 -- 172.21.15.130:0/2187086412 >> 172.21.15.130:0/2187086412 conn(0x7f2d7c006c10 msgr2=0x7f2d7c037890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:22.154 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f2d8b7b5640 1 -- 172.21.15.130:0/2187086412 shutdown_connections 2024-06-11T17:18:22.154 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f77924af640 1 -- 172.21.15.130:0/1328431788 shutdown_connections 2024-06-11T17:18:22.154 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f77924af640 1 --2- 172.21.15.130:0/1328431788 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77840cbb30 0x7f77840cbfe0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.154 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f77924af640 1 --2- 172.21.15.130:0/1328431788 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7784007c70 0x7f778402ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.154 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f77924af640 1 -- 172.21.15.130:0/1328431788 >> 172.21.15.130:0/1328431788 conn(0x7f7784006b20 msgr2=0x7f7784006f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:22.154 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f4ecfdaf640 1 -- 172.21.15.130:0/2344297781 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4eb0000f90 con 0x7f4ec0036910 2024-06-11T17:18:22.155 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f61faffd640 1 --2- 172.21.15.130:0/2994296010 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f61fc0aefb0 0x7f61fc0706a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f61f000c460 tx=0x7f61f000c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.155 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f7baf59e640 1 -- 172.21.15.130:0/2508140991 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb0147650 msgr2=0x7f7bb00ab230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.155 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f7baf59e640 1 --2- 172.21.15.130:0/2508140991 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb0147650 0x7f7bb00ab230 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7ba00097c0 tx=0x7f7ba001c250 comp rx=0 tx=0).stop 2024-06-11T17:18:22.155 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f61e3fff640 1 -- 172.21.15.130:0/2994296010 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f00052d0 con 0x7f61fc0aefb0 2024-06-11T17:18:22.155 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f61e3fff640 1 -- 172.21.15.130:0/2994296010 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61f0005470 con 0x7f61fc0aefb0 2024-06-11T17:18:22.156 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f7baf59e640 1 -- 172.21.15.130:0/2508140991 shutdown_connections 2024-06-11T17:18:22.156 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f7baf59e640 1 --2- 172.21.15.130:0/2508140991 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb0147650 0x7f7bb00ab230 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.156 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f7baf59e640 1 -- 172.21.15.130:0/2508140991 >> 172.21.15.130:0/2508140991 conn(0x7f7bb006c900 msgr2=0x7f7bb00b46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:22.156 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f7baf59e640 1 -- 172.21.15.130:0/2508140991 shutdown_connections 2024-06-11T17:18:22.156 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f4ebe7fc640 1 -- 172.21.15.130:0/2344297781 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f4eb8011590 con 0x7f4ec0036910 2024-06-11T17:18:22.156 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f4ebe7fc640 1 --2- 172.21.15.130:0/2344297781 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4eac070e30 0x7f4eac0732f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.157 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f4ebe7fc640 1 -- 172.21.15.130:0/2344297781 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 4090+0+0 (secure 0 0 0) 0x7f4eb8090bc0 con 0x7f4ec0036910 2024-06-11T17:18:22.157 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f4ebe7fc640 1 --2- 172.21.15.130:0/2344297781 >> v2:172.21.15.130:6810/995804279 conn(0x7f4eac076e10 0x7f4eac079230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.157 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f4ebe7fc640 1 -- 172.21.15.130:0/2344297781 --> v2:172.21.15.130:6810/995804279 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4eac0798a0 con 0x7f4eac076e10 2024-06-11T17:18:22.157 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7f2d8b7b5640 1 -- 172.21.15.130:0/2187086412 wait complete. 2024-06-11T17:18:22.157 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f2d8b7b5640 1 Processor -- start 2024-06-11T17:18:22.157 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f4ece34c640 1 --2- 172.21.15.130:0/2344297781 >> v2:172.21.15.130:6810/995804279 conn(0x7f4eac076e10 0x7f4eac079230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.158 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f2c84f6a640 1 --2- 172.21.15.130:0/3006106158 >> v2:172.21.15.130:6800/1675918119 conn(0x7f2c780ca280 0x7f2c780bd520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.158 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f2c84f6a640 1 -- 172.21.15.130:0/3006106158 --> v2:172.21.15.130:6800/1675918119 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2c7802b2c0 con 0x7f2c780ca280 2024-06-11T17:18:22.158 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f2c7ed9d640 1 --2- 172.21.15.130:0/3006106158 >> v2:172.21.15.130:6800/1675918119 conn(0x7f2c780ca280 0x7f2c780bd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.158 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f7baf59e640 1 -- 172.21.15.130:0/2508140991 wait complete. 2024-06-11T17:18:22.159 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f61e3fff640 1 -- 172.21.15.130:0/2994296010 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f0012870 con 0x7f61fc0aefb0 2024-06-11T17:18:22.159 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f6200b73640 1 -- 172.21.15.130:0/2994296010 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61fc14c4c0 con 0x7f61fc0aefb0 2024-06-11T17:18:22.159 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f4ecd34a640 1 --2- 172.21.15.130:0/2344297781 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4eac070e30 0x7f4eac0732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.159 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.126+0000 7fad897df640 1 -- 172.21.15.130:0/2483332654 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fad84072dc0 con 0x7fad840738f0 2024-06-11T17:18:22.159 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f4ece34c640 1 --2- 172.21.15.130:0/2344297781 >> v2:172.21.15.130:6810/995804279 conn(0x7f4eac076e10 0x7f4eac079230 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.160 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f6200b73640 1 -- 172.21.15.130:0/2994296010 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f61fc14b3e0 con 0x7f61fc0aefb0 2024-06-11T17:18:22.160 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f7baf59e640 1 Processor -- start 2024-06-11T17:18:22.160 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f77924af640 1 -- 172.21.15.130:0/1328431788 shutdown_connections 2024-06-11T17:18:22.161 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f6200b73640 1 -- 172.21.15.130:0/2994296010 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f61fc06ff90 con 0x7f61fc0aefb0 2024-06-11T17:18:22.161 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f2c7ed9d640 1 --2- 172.21.15.130:0/3006106158 >> v2:172.21.15.130:6800/1675918119 conn(0x7f2c780ca280 0x7f2c780bd520 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.161 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f61e3fff640 1 -- 172.21.15.130:0/2994296010 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f61f0012a10 con 0x7f61fc0aefb0 2024-06-11T17:18:22.161 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f2d8b7b5640 1 -- start start 2024-06-11T17:18:22.161 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f2d8b7b5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d7c032950 0x7f2d7c033090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.162 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f2d8b7b5640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d7c0c5e80 0x7f2d7c0c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.162 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f2d8b7b5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d7c02e6a0 0x7f2d7c02eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.162 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f2d8b7b5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7c0cacb0 con 0x7f2d7c02e6a0 2024-06-11T17:18:22.162 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f2d8b7b5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7c0cab30 con 0x7f2d7c032950 2024-06-11T17:18:22.162 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f2d8b7b5640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f2d7c0cae30 con 0x7f2d7c0c5e80 2024-06-11T17:18:22.162 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f2c6effd640 1 -- 172.21.15.130:0/3006106158 <== osd.0 v2:172.21.15.130:6800/1675918119 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2c7802b2c0 con 0x7f2c780ca280 2024-06-11T17:18:22.162 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7fad80ff9640 1 -- 172.21.15.130:0/2483332654 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7fad7c005600 con 0x7fad840738f0 2024-06-11T17:18:22.162 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7fad80ff9640 1 --2- 172.21.15.130:0/2483332654 >> v2:172.21.15.130:6816/3863300924 conn(0x7fad70070d60 0x7fad70073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7fad80ff9640 1 -- 172.21.15.130:0/2483332654 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 4090+0+0 (secure 0 0 0) 0x7fad7c090840 con 0x7fad840738f0 2024-06-11T17:18:22.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7fad80ff9640 1 --2- 172.21.15.130:0/2483332654 >> v2:172.21.15.130:6804/1676407705 conn(0x7fad70076d40 0x7fad70079160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7fad80ff9640 1 -- 172.21.15.130:0/2483332654 --> v2:172.21.15.130:6804/1676407705 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fad700797d0 con 0x7fad70076d40 2024-06-11T17:18:22.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7fad88fde640 1 --2- 172.21.15.130:0/2483332654 >> v2:172.21.15.130:6804/1676407705 conn(0x7fad70076d40 0x7fad70079160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7fad83fff640 1 --2- 172.21.15.130:0/2483332654 >> v2:172.21.15.130:6816/3863300924 conn(0x7fad70070d60 0x7fad70073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f7baf59e640 1 -- start start 2024-06-11T17:18:22.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f4ecd34a640 1 --2- 172.21.15.130:0/2344297781 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4eac070e30 0x7f4eac0732f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4ec003a1c0 tx=0x7f4ec40079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.164 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f4ebe7fc640 1 -- 172.21.15.130:0/2344297781 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f4eb8097050 con 0x7f4ec0036910 2024-06-11T17:18:22.164 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f4ebe7fc640 1 -- 172.21.15.130:0/2344297781 <== osd.3 v2:172.21.15.130:6810/995804279 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4eac0798a0 con 0x7f4eac076e10 2024-06-11T17:18:22.164 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f61e3fff640 1 --2- 172.21.15.130:0/2994296010 >> v2:172.21.15.130:6816/3863300924 conn(0x7f61e8070e60 0x7f61e8073320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.164 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f61e3fff640 1 -- 172.21.15.130:0/2994296010 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 4090+0+0 (secure 0 0 0) 0x7f61f0095060 con 0x7f61fc0aefb0 2024-06-11T17:18:22.164 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f61e3fff640 1 --2- 172.21.15.130:0/2994296010 >> v2:172.21.15.172:6812/1264612709 conn(0x7f61e8076e40 0x7f61e8079260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.164 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f61e3fff640 1 -- 172.21.15.130:0/2994296010 --> v2:172.21.15.172:6812/1264612709 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f61f0005470 con 0x7f61e8076e40 2024-06-11T17:18:22.164 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f61e3fff640 1 -- 172.21.15.130:0/2994296010 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f61f0099540 con 0x7f61fc0aefb0 2024-06-11T17:18:22.164 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f61fb7fe640 1 --2- 172.21.15.130:0/2994296010 >> v2:172.21.15.130:6816/3863300924 conn(0x7f61e8070e60 0x7f61e8073320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.165 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f2d89d52640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d7c02e6a0 0x7f2d7c02eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.165 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f2d89d52640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d7c02e6a0 0x7f2d7c02eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38426/0 (socket says 172.21.15.130:38426) 2024-06-11T17:18:22.165 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f2d89d52640 1 -- 172.21.15.130:0/1017922824 learned_addr learned my addr 172.21.15.130:0/1017922824 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:22.165 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f2d88d50640 1 --2- 172.21.15.130:0/1017922824 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d7c0c5e80 0x7f2d7c0c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.165 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f77924af640 1 -- 172.21.15.130:0/1328431788 wait complete. 2024-06-11T17:18:22.165 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.130+0000 7f77924af640 1 Processor -- start 2024-06-11T17:18:22.166 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f61fbfff640 1 --2- 172.21.15.130:0/2994296010 >> v2:172.21.15.172:6812/1264612709 conn(0x7f61e8076e40 0x7f61e8079260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.166 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7fad88fde640 1 --2- 172.21.15.130:0/2483332654 >> v2:172.21.15.130:6804/1676407705 conn(0x7fad70076d40 0x7fad70079160 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.166 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f2d89d52640 1 -- 172.21.15.130:0/1017922824 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d7c0c5e80 msgr2=0x7f2d7c0c62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.166 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f2d89d52640 1 --2- 172.21.15.130:0/1017922824 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d7c0c5e80 0x7f2d7c0c62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.166 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f2d89d52640 1 -- 172.21.15.130:0/1017922824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d7c032950 msgr2=0x7f2d7c033090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.166 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f2d89d52640 1 --2- 172.21.15.130:0/1017922824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d7c032950 0x7f2d7c033090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.167 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f2d89d52640 1 -- 172.21.15.130:0/1017922824 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d7c0c57f0 con 0x7f2d7c02e6a0 2024-06-11T17:18:22.167 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7fad80ff9640 1 -- 172.21.15.130:0/2483332654 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fad7c058940 con 0x7fad840738f0 2024-06-11T17:18:22.167 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f7baf59e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7bb0072e70 0x7f7bb00725a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.167 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f7baf59e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb00aae50 0x7f7bb006fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.167 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f7baf59e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bb0147650 0x7f7bb0070110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.167 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f7baf59e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb0152b10 con 0x7f7bb00aae50 2024-06-11T17:18:22.167 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f7baf59e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb0152990 con 0x7f7bb0147650 2024-06-11T17:18:22.167 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f7baf59e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f7bb0152c90 con 0x7f7bb0072e70 2024-06-11T17:18:22.168 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f7bae59c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7bb0072e70 0x7f7bb00725a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.168 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f7bae59c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7bb0072e70 0x7f7bb00725a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:53576/0 (socket says 172.21.15.130:53576) 2024-06-11T17:18:22.168 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f7bae59c640 1 -- 172.21.15.130:0/1769058004 learned_addr learned my addr 172.21.15.130:0/1769058004 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:22.168 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f7badd9b640 1 --2- 172.21.15.130:0/1769058004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb00aae50 0x7f7bb006fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.168 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f7baed9d640 1 --2- 172.21.15.130:0/1769058004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bb0147650 0x7f7bb0070110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.168 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f61fb7fe640 1 --2- 172.21.15.130:0/2994296010 >> v2:172.21.15.130:6816/3863300924 conn(0x7f61e8070e60 0x7f61e8073320 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009540 tx=0x7f61f4009450 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.168 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f61fbfff640 1 --2- 172.21.15.130:0/2994296010 >> v2:172.21.15.172:6812/1264612709 conn(0x7f61e8076e40 0x7f61e8079260 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.168 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f2d89d52640 1 --2- 172.21.15.130:0/1017922824 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d7c02e6a0 0x7f2d7c02eb20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2d84063bf0 tx=0x7f2d84077490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.169 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f77924af640 1 -- start start 2024-06-11T17:18:22.169 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7fad83fff640 1 --2- 172.21.15.130:0/2483332654 >> v2:172.21.15.130:6816/3863300924 conn(0x7fad70070d60 0x7fad70073220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fad78001ec0 tx=0x7fad78001bb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.169 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f2d79ffb640 1 -- 172.21.15.130:0/1017922824 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d84073040 con 0x7f2d7c02e6a0 2024-06-11T17:18:22.169 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f2d79ffb640 1 -- 172.21.15.130:0/1017922824 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d84069450 con 0x7f2d7c02e6a0 2024-06-11T17:18:22.170 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f2d79ffb640 1 -- 172.21.15.130:0/1017922824 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d84074560 con 0x7f2d7c02e6a0 2024-06-11T17:18:22.170 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f7bae59c640 1 -- 172.21.15.130:0/1769058004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bb0147650 msgr2=0x7f7bb0070110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.170 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f7bae59c640 1 --2- 172.21.15.130:0/1769058004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bb0147650 0x7f7bb0070110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.170 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f7bae59c640 1 -- 172.21.15.130:0/1769058004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb00aae50 msgr2=0x7f7bb006fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.170 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f7bae59c640 1 --2- 172.21.15.130:0/1769058004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb00aae50 0x7f7bb006fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.170 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f7bae59c640 1 -- 172.21.15.130:0/1769058004 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bb00b54b0 con 0x7f7bb0072e70 2024-06-11T17:18:22.170 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f2d8b7b5640 1 -- 172.21.15.130:0/1017922824 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d7c0c5a60 con 0x7f2d7c02e6a0 2024-06-11T17:18:22.171 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f2d8b7b5640 1 -- 172.21.15.130:0/1017922824 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d7c0c5430 con 0x7f2d7c02e6a0 2024-06-11T17:18:22.171 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7fad80ff9640 1 -- 172.21.15.130:0/2483332654 <== osd.1 v2:172.21.15.130:6804/1676407705 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fad700797d0 con 0x7fad70076d40 2024-06-11T17:18:22.171 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f7bae59c640 1 --2- 172.21.15.130:0/1769058004 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7bb0072e70 0x7f7bb00725a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800cab0 tx=0x7f7ba800cf70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.172 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f77924af640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7784007c70 0x7f77840d0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.172 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f77924af640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f778402a1a0 0x7f77841638d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.172 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f77924af640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77840cbb30 0x7f7784163e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.172 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f77924af640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f77840d8b90 con 0x7f778402a1a0 2024-06-11T17:18:22.172 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f77924af640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f778402b160 con 0x7f77840cbb30 2024-06-11T17:18:22.172 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f77924af640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f77840d8d10 con 0x7f7784007c70 2024-06-11T17:18:22.172 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f778bfff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7784007c70 0x7f77840d0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.172 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f778bfff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7784007c70 0x7f77840d0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:53584/0 (socket says 172.21.15.130:53584) 2024-06-11T17:18:22.172 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f778bfff640 1 -- 172.21.15.130:0/875824294 learned_addr learned my addr 172.21.15.130:0/875824294 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:22.172 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f778b7fe640 1 --2- 172.21.15.130:0/875824294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f778402a1a0 0x7f77841638d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.172 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f7790a4c640 1 --2- 172.21.15.130:0/875824294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77840cbb30 0x7f7784163e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.173 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f7b9effd640 1 -- 172.21.15.130:0/1769058004 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8018070 con 0x7f7bb0072e70 2024-06-11T17:18:22.173 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f7b9effd640 1 -- 172.21.15.130:0/1769058004 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ba800a7c0 con 0x7f7bb0072e70 2024-06-11T17:18:22.173 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f7b9effd640 1 -- 172.21.15.130:0/1769058004 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba800abb0 con 0x7f7bb0072e70 2024-06-11T17:18:22.173 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f7baf59e640 1 -- 172.21.15.130:0/1769058004 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bb0143470 con 0x7f7bb0072e70 2024-06-11T17:18:22.173 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f7baf59e640 1 -- 172.21.15.130:0/1769058004 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bb0143a30 con 0x7f7bb0072e70 2024-06-11T17:18:22.174 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f778bfff640 1 -- 172.21.15.130:0/875824294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77840cbb30 msgr2=0x7f7784163e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.174 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f778bfff640 1 --2- 172.21.15.130:0/875824294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77840cbb30 0x7f7784163e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.174 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f778bfff640 1 -- 172.21.15.130:0/875824294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f778402a1a0 msgr2=0x7f77841638d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.174 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f778bfff640 1 --2- 172.21.15.130:0/875824294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f778402a1a0 0x7f77841638d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.174 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.134+0000 7f778bfff640 1 -- 172.21.15.130:0/875824294 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77840d1990 con 0x7f7784007c70 2024-06-11T17:18:22.174 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.138+0000 7f778bfff640 1 --2- 172.21.15.130:0/875824294 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7784007c70 0x7f77840d0180 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f778000ebe0 tx=0x7f778000c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.174 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.138+0000 7f7baf59e640 1 -- 172.21.15.130:0/1769058004 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7bb00ab230 con 0x7f7bb0072e70 2024-06-11T17:18:22.174 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.138+0000 7f61e3fff640 1 -- 172.21.15.130:0/2994296010 <== osd.4 v2:172.21.15.172:6812/1264612709 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f61f0005470 con 0x7f61e8076e40 2024-06-11T17:18:22.175 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.138+0000 7f2d79ffb640 1 -- 172.21.15.130:0/1017922824 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f2d84095640 con 0x7f2d7c02e6a0 2024-06-11T17:18:22.175 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.138+0000 7f7788ff9640 1 -- 172.21.15.130:0/875824294 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7780017070 con 0x7f7784007c70 2024-06-11T17:18:22.175 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.138+0000 7f7788ff9640 1 -- 172.21.15.130:0/875824294 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f778000cc30 con 0x7f7784007c70 2024-06-11T17:18:22.175 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.138+0000 7f2d79ffb640 1 --2- 172.21.15.130:0/1017922824 >> v2:172.21.15.130:6816/3863300924 conn(0x7f2d68070d60 0x7f2d68073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.176 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.138+0000 7f2d79ffb640 1 -- 172.21.15.130:0/1017922824 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4090+0+0 (secure 0 0 0) 0x7f2d8410c040 con 0x7f2d7c02e6a0 2024-06-11T17:18:22.176 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.138+0000 7fc5ff59e640 1 Processor -- start 2024-06-11T17:18:22.176 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.138+0000 7fc5ff59e640 1 -- start start 2024-06-11T17:18:22.176 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.138+0000 7fc5ff59e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc5f80371d0 0x7fc5f80c1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.176 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.138+0000 7fc5ff59e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc5f80c1b60 0x7fc5f80c7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.176 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.138+0000 7fc5ff59e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5f802d220 con 0x7fc5f80c7dd0 2024-06-11T17:18:22.176 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.138+0000 7fc5ff59e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fc5f80375b0 con 0x7fc5f80371d0 2024-06-11T17:18:22.177 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.138+0000 7fc5ff59e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc5f802b060 con 0x7fc5f80c1b60 2024-06-11T17:18:22.177 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.138+0000 7fc5fe59c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc5f80371d0 0x7fc5f80c1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.177 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.138+0000 7fc5fe59c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc5f80371d0 0x7fc5f80c1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.130:57218/0 (socket says 172.21.15.130:57218) 2024-06-11T17:18:22.177 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.138+0000 7fc5fe59c640 1 -- 172.21.15.130:0/364327455 learned_addr learned my addr 172.21.15.130:0/364327455 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:22.177 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.138+0000 7f7b9effd640 1 -- 172.21.15.130:0/1769058004 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f7ba80070d0 con 0x7f7bb0072e70 2024-06-11T17:18:22.177 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.138+0000 7f7b9effd640 1 --2- 172.21.15.130:0/1769058004 >> v2:172.21.15.130:6816/3863300924 conn(0x7f7b90070d60 0x7f7b90073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.177 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.138+0000 7f7b9effd640 1 -- 172.21.15.130:0/1769058004 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 4090+0+0 (secure 0 0 0) 0x7f7ba8090800 con 0x7f7bb0072e70 2024-06-11T17:18:22.177 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.138+0000 7f7b9effd640 1 --2- 172.21.15.130:0/1769058004 >> v2:172.21.15.130:6808/272447947 conn(0x7f7b90076d40 0x7f7b90079160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.177 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.138+0000 7f7b9effd640 1 -- 172.21.15.130:0/1769058004 --> v2:172.21.15.130:6808/272447947 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7b900797d0 con 0x7f7b90076d40 2024-06-11T17:18:22.178 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.138+0000 7f7b9effd640 1 -- 172.21.15.130:0/1769058004 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f7ba8090c90 con 0x7f7bb0072e70 2024-06-11T17:18:22.178 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.138+0000 7f7788ff9640 1 -- 172.21.15.130:0/875824294 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7780013470 con 0x7f7784007c70 2024-06-11T17:18:22.178 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.138+0000 7f77924af640 1 -- 172.21.15.130:0/875824294 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77840cf570 con 0x7f7784007c70 2024-06-11T17:18:22.178 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.138+0000 7f77924af640 1 -- 172.21.15.130:0/875824294 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f77840cfb70 con 0x7f7784007c70 2024-06-11T17:18:22.178 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.138+0000 7f77924af640 1 -- 172.21.15.130:0/875824294 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f778402ab10 con 0x7f7784007c70 2024-06-11T17:18:22.179 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.142+0000 7f7baed9d640 1 --2- 172.21.15.130:0/1769058004 >> v2:172.21.15.130:6808/272447947 conn(0x7f7b90076d40 0x7f7b90079160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.179 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.142+0000 7f7baed9d640 1 --2- 172.21.15.130:0/1769058004 >> v2:172.21.15.130:6808/272447947 conn(0x7f7b90076d40 0x7f7b90079160 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.179 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.142+0000 7f7b9effd640 1 -- 172.21.15.130:0/1769058004 <== osd.2 v2:172.21.15.130:6808/272447947 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7b900797d0 con 0x7f7b90076d40 2024-06-11T17:18:22.179 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.142+0000 7fc5fe59c640 1 -- 172.21.15.130:0/364327455 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc5f80c1b60 msgr2=0x7fc5f80c7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:22.179 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.142+0000 7fc5fe59c640 1 --2- 172.21.15.130:0/364327455 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc5f80c1b60 0x7fc5f80c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.179 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.142+0000 7fc5fe59c640 1 -- 172.21.15.130:0/364327455 >> v1:172.21.15.130:6789/0 conn(0x7fc5f80c7dd0 legacy=0x7fc5f8035770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:22.179 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.142+0000 7fc5fe59c640 1 -- 172.21.15.130:0/364327455 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f80c1f80 con 0x7fc5f80371d0 2024-06-11T17:18:22.180 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.146+0000 7f7badd9b640 1 --2- 172.21.15.130:0/1769058004 >> v2:172.21.15.130:6816/3863300924 conn(0x7f7b90070d60 0x7f7b90073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.180 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.146+0000 7f2d89551640 1 --2- 172.21.15.130:0/1017922824 >> v2:172.21.15.130:6816/3863300924 conn(0x7f2d68070d60 0x7f2d68073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.180 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.146+0000 7f2d89551640 1 --2- 172.21.15.130:0/1017922824 >> v2:172.21.15.130:6816/3863300924 conn(0x7f2d68070d60 0x7f2d68073220 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2d740018a0 tx=0x7f2d74001250 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.180 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.146+0000 7f7badd9b640 1 --2- 172.21.15.130:0/1769058004 >> v2:172.21.15.130:6816/3863300924 conn(0x7f7b90070d60 0x7f7b90073220 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0071e50 tx=0x7f7ba400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.181 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.146+0000 7f7788ff9640 1 -- 172.21.15.130:0/875824294 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f778001a070 con 0x7f7784007c70 2024-06-11T17:18:22.181 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.146+0000 7f2d8b7b5640 1 --2- 172.21.15.130:0/1017922824 >> v2:172.21.15.172:6800/63774775 conn(0x7f2d7c0bf020 0x7f2d7c0c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.181 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.146+0000 7f2d8b7b5640 1 -- 172.21.15.130:0/1017922824 --> v2:172.21.15.172:6800/63774775 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2d7c02f570 con 0x7f2d7c0bf020 2024-06-11T17:18:22.181 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.146+0000 7fc5fe59c640 1 --2- 172.21.15.130:0/364327455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f80371d0 0x7fc5f80c1620 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc60006a5d0 tx=0x7fc60009a2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2dad334ad550e6d5 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.181 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.146+0000 7f7788ff9640 1 --2- 172.21.15.130:0/875824294 >> v2:172.21.15.130:6816/3863300924 conn(0x7f7770070d60 0x7f7770073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.182 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.146+0000 7f2d88d50640 1 --2- 172.21.15.130:0/1017922824 >> v2:172.21.15.172:6800/63774775 conn(0x7f2d7c0bf020 0x7f2d7c0c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.182 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.146+0000 7f7788ff9640 1 -- 172.21.15.130:0/875824294 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 4090+0+0 (secure 0 0 0) 0x7f7780090cb0 con 0x7f7784007c70 2024-06-11T17:18:22.182 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.146+0000 7f7788ff9640 1 --2- 172.21.15.130:0/875824294 >> v2:172.21.15.172:6801/3950047248 conn(0x7f7770076d40 0x7f7770079160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.182 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.146+0000 7f7788ff9640 1 -- 172.21.15.130:0/875824294 --> v2:172.21.15.172:6801/3950047248 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7780009400 con 0x7f7770076d40 2024-06-11T17:18:22.182 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.146+0000 7f7788ff9640 1 -- 172.21.15.130:0/875824294 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f77800910a0 con 0x7f7784007c70 2024-06-11T17:18:22.182 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.146+0000 7f778b7fe640 1 --2- 172.21.15.130:0/875824294 >> v2:172.21.15.130:6816/3863300924 conn(0x7f7770070d60 0x7f7770073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.183 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.146+0000 7fc5fd59a640 1 -- 172.21.15.130:0/364327455 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc600071460 con 0x7fc5f80371d0 2024-06-11T17:18:22.183 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.146+0000 7fc5fd59a640 1 -- 172.21.15.130:0/364327455 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc600071640 con 0x7fc5f80371d0 2024-06-11T17:18:22.183 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.146+0000 7fc5fd59a640 1 -- 172.21.15.130:0/364327455 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc600071ab0 con 0x7fc5f80371d0 2024-06-11T17:18:22.183 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.146+0000 7f7790a4c640 1 --2- 172.21.15.130:0/875824294 >> v2:172.21.15.172:6801/3950047248 conn(0x7f7770076d40 0x7f7770079160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.184 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.146+0000 7f778b7fe640 1 --2- 172.21.15.130:0/875824294 >> v2:172.21.15.130:6816/3863300924 conn(0x7f7770070d60 0x7f7770073220 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f77840cf520 tx=0x7f7778009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.184 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.150+0000 7f7790a4c640 1 --2- 172.21.15.130:0/875824294 >> v2:172.21.15.172:6801/3950047248 conn(0x7f7770076d40 0x7f7770079160 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.184 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.150+0000 7fc5ff59e640 1 -- 172.21.15.130:0/364327455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f80371d0 msgr2=0x7fc5f80c1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.184 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.150+0000 7fc5ff59e640 1 --2- 172.21.15.130:0/364327455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f80371d0 0x7fc5f80c1620 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc60006a5d0 tx=0x7fc60009a2d0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.184 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.150+0000 7fc5ff59e640 1 -- 172.21.15.130:0/364327455 shutdown_connections 2024-06-11T17:18:22.184 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.150+0000 7fc5ff59e640 1 --2- 172.21.15.130:0/364327455 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc5f80c1b60 0x7fc5f80c7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.185 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.150+0000 7fc5ff59e640 1 --2- 172.21.15.130:0/364327455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f80371d0 0x7fc5f80c1620 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.185 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.150+0000 7fc5ff59e640 1 -- 172.21.15.130:0/364327455 >> 172.21.15.130:0/364327455 conn(0x7fc5f803a400 msgr2=0x7fc5f8036860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:22.185 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.150+0000 7fc5ff59e640 1 -- 172.21.15.130:0/364327455 shutdown_connections 2024-06-11T17:18:22.185 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.150+0000 7f7788ff9640 1 -- 172.21.15.130:0/875824294 <== osd.7 v2:172.21.15.172:6801/3950047248 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7780009400 con 0x7f7770076d40 2024-06-11T17:18:22.185 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.150+0000 7fc5ff59e640 1 -- 172.21.15.130:0/364327455 wait complete. 2024-06-11T17:18:22.185 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.150+0000 7fc5ff59e640 1 Processor -- start 2024-06-11T17:18:22.186 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.150+0000 7f2d88d50640 1 --2- 172.21.15.130:0/1017922824 >> v2:172.21.15.172:6800/63774775 conn(0x7f2d7c0bf020 0x7f2d7c0c8930 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.186 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.150+0000 7fc5ff59e640 1 -- start start 2024-06-11T17:18:22.186 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.150+0000 7fc5ff59e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f80371d0 0x7fc5f802e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.186 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.150+0000 7fc5ff59e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc5f80c1b60 0x7fc5f80c4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.186 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.150+0000 7fc5ff59e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5f80c7dd0 0x7fc5f8030b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.186 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.150+0000 7fc5ff59e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f802bfb0 con 0x7fc5f80c7dd0 2024-06-11T17:18:22.187 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.150+0000 7fc5ff59e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f802ad80 con 0x7fc5f80371d0 2024-06-11T17:18:22.187 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.150+0000 7fc5ff59e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc5f802c130 con 0x7fc5f80c1b60 2024-06-11T17:18:22.187 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.150+0000 7fc5fdd9b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc5f80c1b60 0x7fc5f80c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.187 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.150+0000 7fc5fdd9b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc5f80c1b60 0x7fc5f80c4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:53602/0 (socket says 172.21.15.130:53602) 2024-06-11T17:18:22.187 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.150+0000 7fc5fdd9b640 1 -- 172.21.15.130:0/1092126060 learned_addr learned my addr 172.21.15.130:0/1092126060 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:22.187 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.154+0000 7fc5fe59c640 1 --2- 172.21.15.130:0/1092126060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f80371d0 0x7fc5f802e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.187 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.154+0000 7f2d79ffb640 1 -- 172.21.15.130:0/1017922824 <== osd.5 v2:172.21.15.172:6800/63774775 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2d7c02f570 con 0x7f2d7c0bf020 2024-06-11T17:18:22.188 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.154+0000 7fc5fe59c640 1 -- 172.21.15.130:0/1092126060 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc5f80c1b60 msgr2=0x7fc5f80c4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.188 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.154+0000 7fc5fe59c640 1 --2- 172.21.15.130:0/1092126060 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc5f80c1b60 0x7fc5f80c4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.188 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.154+0000 7fc5fe59c640 1 -- 172.21.15.130:0/1092126060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5f80c7dd0 msgr2=0x7fc5f8030b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.188 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.154+0000 7fc5fe59c640 1 --2- 172.21.15.130:0/1092126060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5f80c7dd0 0x7fc5f8030b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.188 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.154+0000 7fc5fe59c640 1 -- 172.21.15.130:0/1092126060 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f80c48a0 con 0x7fc5f80371d0 2024-06-11T17:18:22.188 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.154+0000 7fc5fe59c640 1 --2- 172.21.15.130:0/1092126060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f80371d0 0x7fc5f802e9b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc60007b450 tx=0x7fc600097110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.188 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.154+0000 7fc5eeffd640 1 -- 172.21.15.130:0/1092126060 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc600071340 con 0x7fc5f80371d0 2024-06-11T17:18:22.188 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.154+0000 7fc5ff59e640 1 -- 172.21.15.130:0/1092126060 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5f8030460 con 0x7fc5f80371d0 2024-06-11T17:18:22.189 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.154+0000 7fc5ff59e640 1 -- 172.21.15.130:0/1092126060 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5f802f170 con 0x7fc5f80371d0 2024-06-11T17:18:22.189 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.154+0000 7fc5eeffd640 1 -- 172.21.15.130:0/1092126060 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc600131420 con 0x7fc5f80371d0 2024-06-11T17:18:22.189 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.154+0000 7fc5eeffd640 1 -- 172.21.15.130:0/1092126060 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6001315d0 con 0x7fc5f80371d0 2024-06-11T17:18:22.189 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.158+0000 7f6200b73640 1 -- 172.21.15.130:0/2994296010 --> v2:172.21.15.172:6812/1264612709 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f61fc071290 con 0x7f61e8076e40 2024-06-11T17:18:22.189 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.158+0000 7f61e3fff640 1 -- 172.21.15.130:0/2994296010 <== osd.4 v2:172.21.15.172:6812/1264612709 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f61fc071290 con 0x7f61e8076e40 2024-06-11T17:18:22.189 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.158+0000 7fc5eeffd640 1 -- 172.21.15.130:0/1092126060 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7fc600071050 con 0x7fc5f80371d0 2024-06-11T17:18:22.189 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.158+0000 7fc5eeffd640 1 --2- 172.21.15.130:0/1092126060 >> v2:172.21.15.130:6816/3863300924 conn(0x7fc5e0070e30 0x7fc5e00732f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.190 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.158+0000 7fc5fdd9b640 1 --2- 172.21.15.130:0/1092126060 >> v2:172.21.15.130:6816/3863300924 conn(0x7fc5e0070e30 0x7fc5e00732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.190 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.158+0000 7fc5eeffd640 1 -- 172.21.15.130:0/1092126060 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4090+0+0 (secure 0 0 0) 0x7fc6001a5b40 con 0x7fc5f80371d0 2024-06-11T17:18:22.190 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.158+0000 7f61e1ffb640 1 -- 172.21.15.130:0/2994296010 >> v2:172.21.15.172:6812/1264612709 conn(0x7f61e8076e40 msgr2=0x7f61e8079260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.190 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.158+0000 7f61e1ffb640 1 --2- 172.21.15.130:0/2994296010 >> v2:172.21.15.172:6812/1264612709 conn(0x7f61e8076e40 0x7f61e8079260 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.190 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.158+0000 7f61e1ffb640 1 -- 172.21.15.130:0/2994296010 >> v2:172.21.15.130:6816/3863300924 conn(0x7f61e8070e60 msgr2=0x7f61e8073320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.190 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.158+0000 7f61e1ffb640 1 --2- 172.21.15.130:0/2994296010 >> v2:172.21.15.130:6816/3863300924 conn(0x7f61e8070e60 0x7f61e8073320 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009540 tx=0x7f61f4009450 comp rx=0 tx=0).stop 2024-06-11T17:18:22.191 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.158+0000 7f61e1ffb640 1 -- 172.21.15.130:0/2994296010 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f61fc0aefb0 msgr2=0x7f61fc0706a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.191 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.158+0000 7f61e1ffb640 1 --2- 172.21.15.130:0/2994296010 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f61fc0aefb0 0x7f61fc0706a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f61f000c460 tx=0x7f61f000c920 comp rx=0 tx=0).stop 2024-06-11T17:18:22.191 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.158+0000 7f61fbfff640 1 -- 172.21.15.130:0/2994296010 reap_dead start 2024-06-11T17:18:22.191 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.158+0000 7f61e1ffb640 1 -- 172.21.15.130:0/2994296010 shutdown_connections 2024-06-11T17:18:22.191 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.158+0000 7f61e1ffb640 1 -- 172.21.15.130:0/2994296010 >> 172.21.15.130:0/2994296010 conn(0x7f61fc06c6b0 msgr2=0x7f61fc0b1860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:22.191 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.158+0000 7fc5fdd9b640 1 --2- 172.21.15.130:0/1092126060 >> v2:172.21.15.130:6816/3863300924 conn(0x7fc5e0070e30 0x7fc5e00732f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc5f80c4c70 tx=0x7fc5f40091c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.191 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.158+0000 7f61e1ffb640 1 -- 172.21.15.130:0/2994296010 shutdown_connections 2024-06-11T17:18:22.192 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.158+0000 7f61e1ffb640 1 -- 172.21.15.130:0/2994296010 wait complete. 2024-06-11T17:18:22.192 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.158+0000 7fc5ff59e640 1 --2- 172.21.15.130:0/1092126060 >> v2:172.21.15.172:6808/1734469189 conn(0x7fc5e4001640 0x7fc5e4003b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.192 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.162+0000 7fc5ff59e640 1 -- 172.21.15.130:0/1092126060 --> v2:172.21.15.172:6808/1734469189 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc5e4006ab0 con 0x7fc5e4001640 2024-06-11T17:18:22.192 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.162+0000 7fc60498a640 1 --2- 172.21.15.130:0/1092126060 >> v2:172.21.15.172:6808/1734469189 conn(0x7fc5e4001640 0x7fc5e4003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.192 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.162+0000 7fc60498a640 1 --2- 172.21.15.130:0/1092126060 >> v2:172.21.15.172:6808/1734469189 conn(0x7fc5e4001640 0x7fc5e4003b00 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.193 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.162+0000 7f2c84f6a640 1 -- 172.21.15.130:0/3006106158 --> v2:172.21.15.130:6800/1675918119 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2c78033b40 con 0x7f2c780ca280 2024-06-11T17:18:22.193 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.162+0000 7f4ecfdaf640 1 -- 172.21.15.130:0/2344297781 --> v2:172.21.15.130:6810/995804279 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4eb0002c80 con 0x7f4eac076e10 2024-06-11T17:18:22.193 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.162+0000 7f4ebe7fc640 1 -- 172.21.15.130:0/2344297781 <== osd.3 v2:172.21.15.130:6810/995804279 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4eb0002c80 con 0x7f4eac076e10 2024-06-11T17:18:22.194 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.162+0000 7f2c6effd640 1 -- 172.21.15.130:0/3006106158 <== osd.0 v2:172.21.15.130:6800/1675918119 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2c78033b40 con 0x7f2c780ca280 2024-06-11T17:18:22.194 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.162+0000 7fc5eeffd640 1 -- 172.21.15.130:0/1092126060 <== osd.6 v2:172.21.15.172:6808/1734469189 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc5e4006ab0 con 0x7fc5e4001640 2024-06-11T17:18:22.195 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.162+0000 7f2c6cff9640 1 -- 172.21.15.130:0/3006106158 >> v2:172.21.15.130:6800/1675918119 conn(0x7f2c780ca280 msgr2=0x7f2c780bd520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.195 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.162+0000 7f2c6cff9640 1 --2- 172.21.15.130:0/3006106158 >> v2:172.21.15.130:6800/1675918119 conn(0x7f2c780ca280 0x7f2c780bd520 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.195 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.162+0000 7f2c6cff9640 1 -- 172.21.15.130:0/3006106158 >> v2:172.21.15.130:6816/3863300924 conn(0x7f2c60070e30 msgr2=0x7f2c600732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.195 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.162+0000 7f2c6cff9640 1 --2- 172.21.15.130:0/3006106158 >> v2:172.21.15.130:6816/3863300924 conn(0x7f2c60070e30 0x7f2c600732f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2c74001750 tx=0x7f2c74009040 comp rx=0 tx=0).stop 2024-06-11T17:18:22.195 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.162+0000 7f2c6cff9640 1 -- 172.21.15.130:0/3006106158 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2c78037110 msgr2=0x7f2c780cacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.195 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.162+0000 7f2c6cff9640 1 --2- 172.21.15.130:0/3006106158 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2c78037110 0x7f2c780cacb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2c7000e810 tx=0x7f2c7000ecd0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.195 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.162+0000 7f2c7ed9d640 1 -- 172.21.15.130:0/3006106158 reap_dead start 2024-06-11T17:18:22.195 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.162+0000 7f2c6cff9640 1 -- 172.21.15.130:0/3006106158 shutdown_connections 2024-06-11T17:18:22.195 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.162+0000 7f2c6cff9640 1 -- 172.21.15.130:0/3006106158 >> 172.21.15.130:0/3006106158 conn(0x7f2c7803a400 msgr2=0x7f2c780d1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:22.195 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.162+0000 7f2c6cff9640 1 -- 172.21.15.130:0/3006106158 shutdown_connections 2024-06-11T17:18:22.195 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.162+0000 7f2c6cff9640 1 -- 172.21.15.130:0/3006106158 wait complete. 2024-06-11T17:18:22.196 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.166+0000 7fad897df640 1 -- 172.21.15.130:0/2483332654 --> v2:172.21.15.130:6804/1676407705 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fad84143b20 con 0x7fad70076d40 2024-06-11T17:18:22.196 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.166+0000 7fad80ff9640 1 -- 172.21.15.130:0/2483332654 <== osd.1 v2:172.21.15.130:6804/1676407705 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fad84143b20 con 0x7fad70076d40 2024-06-11T17:18:22.197 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.166+0000 7f4eabfff640 1 -- 172.21.15.130:0/2344297781 >> v2:172.21.15.130:6810/995804279 conn(0x7f4eac076e10 msgr2=0x7f4eac079230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.197 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.166+0000 7f4eabfff640 1 --2- 172.21.15.130:0/2344297781 >> v2:172.21.15.130:6810/995804279 conn(0x7f4eac076e10 0x7f4eac079230 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.197 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.166+0000 7f4eabfff640 1 -- 172.21.15.130:0/2344297781 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4eac070e30 msgr2=0x7f4eac0732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.197 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.166+0000 7f4eabfff640 1 --2- 172.21.15.130:0/2344297781 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4eac070e30 0x7f4eac0732f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4ec003a1c0 tx=0x7f4ec40079c0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.197 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.166+0000 7f4eabfff640 1 -- 172.21.15.130:0/2344297781 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ec0036910 msgr2=0x7f4ec00ccc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.197 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.166+0000 7f4eabfff640 1 --2- 172.21.15.130:0/2344297781 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ec0036910 0x7f4ec00ccc80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4eb800c7c0 tx=0x7f4eb800cc80 comp rx=0 tx=0).stop 2024-06-11T17:18:22.197 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.166+0000 7f4ece34c640 1 -- 172.21.15.130:0/2344297781 reap_dead start 2024-06-11T17:18:22.197 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.166+0000 7f4eabfff640 1 -- 172.21.15.130:0/2344297781 shutdown_connections 2024-06-11T17:18:22.197 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.166+0000 7f4eabfff640 1 -- 172.21.15.130:0/2344297781 >> 172.21.15.130:0/2344297781 conn(0x7f4ec0005d80 msgr2=0x7f4ec003a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:22.198 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.166+0000 7fad897df640 1 -- 172.21.15.130:0/2483332654 >> v2:172.21.15.130:6804/1676407705 conn(0x7fad70076d40 msgr2=0x7fad70079160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.198 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.166+0000 7fad897df640 1 --2- 172.21.15.130:0/2483332654 >> v2:172.21.15.130:6804/1676407705 conn(0x7fad70076d40 0x7fad70079160 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.198 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.166+0000 7fad897df640 1 -- 172.21.15.130:0/2483332654 >> v2:172.21.15.130:6816/3863300924 conn(0x7fad70070d60 msgr2=0x7fad70073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.198 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.166+0000 7fad897df640 1 --2- 172.21.15.130:0/2483332654 >> v2:172.21.15.130:6816/3863300924 conn(0x7fad70070d60 0x7fad70073220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fad78001ec0 tx=0x7fad78001bb0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.198 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.166+0000 7fad897df640 1 -- 172.21.15.130:0/2483332654 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad840738f0 msgr2=0x7fad84131630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.198 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.166+0000 7fad897df640 1 --2- 172.21.15.130:0/2483332654 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad840738f0 0x7fad84131630 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fad7c00c7a0 tx=0x7fad7c00cc60 comp rx=0 tx=0).stop 2024-06-11T17:18:22.198 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.166+0000 7fad88fde640 1 -- 172.21.15.130:0/2483332654 reap_dead start 2024-06-11T17:18:22.198 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.166+0000 7fad897df640 1 -- 172.21.15.130:0/2483332654 shutdown_connections 2024-06-11T17:18:22.198 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.166+0000 7fad897df640 1 -- 172.21.15.130:0/2483332654 >> 172.21.15.130:0/2483332654 conn(0x7fad840b2650 msgr2=0x7fad84137e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:22.199 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.166+0000 7f4eabfff640 1 -- 172.21.15.130:0/2344297781 shutdown_connections 2024-06-11T17:18:22.199 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.166+0000 7f4eabfff640 1 -- 172.21.15.130:0/2344297781 wait complete. 2024-06-11T17:18:22.199 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.170+0000 7fad897df640 1 -- 172.21.15.130:0/2483332654 shutdown_connections 2024-06-11T17:18:22.199 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.170+0000 7fad897df640 1 -- 172.21.15.130:0/2483332654 wait complete. 2024-06-11T17:18:22.200 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.170+0000 7f7baf59e640 1 -- 172.21.15.130:0/1769058004 --> v2:172.21.15.130:6808/272447947 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7bb0153550 con 0x7f7b90076d40 2024-06-11T17:18:22.200 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.170+0000 7f7b9effd640 1 -- 172.21.15.130:0/1769058004 <== osd.2 v2:172.21.15.130:6808/272447947 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7bb0153550 con 0x7f7b90076d40 2024-06-11T17:18:22.200 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.178+0000 7f77924af640 1 -- 172.21.15.130:0/875824294 --> v2:172.21.15.172:6801/3950047248 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f77840d0910 con 0x7f7770076d40 2024-06-11T17:18:22.201 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.178+0000 7f7baf59e640 1 -- 172.21.15.130:0/1769058004 >> v2:172.21.15.130:6808/272447947 conn(0x7f7b90076d40 msgr2=0x7f7b90079160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.201 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.178+0000 7f7baf59e640 1 --2- 172.21.15.130:0/1769058004 >> v2:172.21.15.130:6808/272447947 conn(0x7f7b90076d40 0x7f7b90079160 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.201 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.178+0000 7f7baf59e640 1 -- 172.21.15.130:0/1769058004 >> v2:172.21.15.130:6816/3863300924 conn(0x7f7b90070d60 msgr2=0x7f7b90073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.201 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.178+0000 7f7baf59e640 1 --2- 172.21.15.130:0/1769058004 >> v2:172.21.15.130:6816/3863300924 conn(0x7f7b90070d60 0x7f7b90073220 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0071e50 tx=0x7f7ba400b040 comp rx=0 tx=0).stop 2024-06-11T17:18:22.201 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.178+0000 7f7baf59e640 1 -- 172.21.15.130:0/1769058004 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7bb0072e70 msgr2=0x7f7bb00725a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.202 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.178+0000 7f7baf59e640 1 --2- 172.21.15.130:0/1769058004 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7bb0072e70 0x7f7bb00725a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800cab0 tx=0x7f7ba800cf70 comp rx=0 tx=0).stop 2024-06-11T17:18:22.202 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.178+0000 7f7baed9d640 1 -- 172.21.15.130:0/1769058004 reap_dead start 2024-06-11T17:18:22.202 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.178+0000 7f7baf59e640 1 -- 172.21.15.130:0/1769058004 shutdown_connections 2024-06-11T17:18:22.202 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.178+0000 7f7baf59e640 1 -- 172.21.15.130:0/1769058004 >> 172.21.15.130:0/1769058004 conn(0x7f7bb006c900 msgr2=0x7f7bb00ae2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:22.202 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.178+0000 7f7baf59e640 1 -- 172.21.15.130:0/1769058004 shutdown_connections 2024-06-11T17:18:22.202 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.178+0000 7f7baf59e640 1 -- 172.21.15.130:0/1769058004 wait complete. 2024-06-11T17:18:22.202 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.178+0000 7f7788ff9640 1 -- 172.21.15.130:0/875824294 <== osd.7 v2:172.21.15.172:6801/3950047248 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f77840d0910 con 0x7f7770076d40 2024-06-11T17:18:22.203 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.178+0000 7f77767fc640 1 -- 172.21.15.130:0/875824294 >> v2:172.21.15.172:6801/3950047248 conn(0x7f7770076d40 msgr2=0x7f7770079160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.203 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.178+0000 7f77767fc640 1 --2- 172.21.15.130:0/875824294 >> v2:172.21.15.172:6801/3950047248 conn(0x7f7770076d40 0x7f7770079160 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.203 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.178+0000 7f77767fc640 1 -- 172.21.15.130:0/875824294 >> v2:172.21.15.130:6816/3863300924 conn(0x7f7770070d60 msgr2=0x7f7770073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.203 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.178+0000 7f77767fc640 1 --2- 172.21.15.130:0/875824294 >> v2:172.21.15.130:6816/3863300924 conn(0x7f7770070d60 0x7f7770073220 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f77840cf520 tx=0x7f7778009040 comp rx=0 tx=0).stop 2024-06-11T17:18:22.203 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.178+0000 7f77767fc640 1 -- 172.21.15.130:0/875824294 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7784007c70 msgr2=0x7f77840d0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.203 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.178+0000 7f77767fc640 1 --2- 172.21.15.130:0/875824294 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7784007c70 0x7f77840d0180 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f778000ebe0 tx=0x7f778000c520 comp rx=0 tx=0).stop 2024-06-11T17:18:22.203 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.178+0000 7f7790a4c640 1 -- 172.21.15.130:0/875824294 reap_dead start 2024-06-11T17:18:22.203 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.178+0000 7f77767fc640 1 -- 172.21.15.130:0/875824294 shutdown_connections 2024-06-11T17:18:22.204 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.178+0000 7f77767fc640 1 -- 172.21.15.130:0/875824294 >> 172.21.15.130:0/875824294 conn(0x7f7784006b20 msgr2=0x7f77840c5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:22.204 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.178+0000 7f77767fc640 1 -- 172.21.15.130:0/875824294 shutdown_connections 2024-06-11T17:18:22.204 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.178+0000 7f77767fc640 1 -- 172.21.15.130:0/875824294 wait complete. 2024-06-11T17:18:22.204 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.182+0000 7f2d8b7b5640 1 -- 172.21.15.130:0/1017922824 --> v2:172.21.15.172:6800/63774775 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2d7c0c4ac0 con 0x7f2d7c0bf020 2024-06-11T17:18:22.204 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.182+0000 7f2d79ffb640 1 -- 172.21.15.130:0/1017922824 <== osd.5 v2:172.21.15.172:6800/63774775 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2d7c0c4ac0 con 0x7f2d7c0bf020 2024-06-11T17:18:22.205 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.182+0000 7f2d677fe640 1 -- 172.21.15.130:0/1017922824 >> v2:172.21.15.172:6800/63774775 conn(0x7f2d7c0bf020 msgr2=0x7f2d7c0c8930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.206 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.182+0000 7f2d677fe640 1 --2- 172.21.15.130:0/1017922824 >> v2:172.21.15.172:6800/63774775 conn(0x7f2d7c0bf020 0x7f2d7c0c8930 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.206 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.182+0000 7f2d677fe640 1 -- 172.21.15.130:0/1017922824 >> v2:172.21.15.130:6816/3863300924 conn(0x7f2d68070d60 msgr2=0x7f2d68073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.206 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.182+0000 7f2d677fe640 1 --2- 172.21.15.130:0/1017922824 >> v2:172.21.15.130:6816/3863300924 conn(0x7f2d68070d60 0x7f2d68073220 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2d740018a0 tx=0x7f2d74001250 comp rx=0 tx=0).stop 2024-06-11T17:18:22.206 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.182+0000 7f2d677fe640 1 -- 172.21.15.130:0/1017922824 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d7c02e6a0 msgr2=0x7f2d7c02eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.206 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.182+0000 7f2d677fe640 1 --2- 172.21.15.130:0/1017922824 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d7c02e6a0 0x7f2d7c02eb20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2d84063bf0 tx=0x7f2d84077490 comp rx=0 tx=0).stop 2024-06-11T17:18:22.206 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.182+0000 7f2d89d52640 1 -- 172.21.15.130:0/1017922824 reap_dead start 2024-06-11T17:18:22.206 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.182+0000 7f2d677fe640 1 -- 172.21.15.130:0/1017922824 shutdown_connections 2024-06-11T17:18:22.206 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.182+0000 7f2d677fe640 1 -- 172.21.15.130:0/1017922824 >> 172.21.15.130:0/1017922824 conn(0x7f2d7c006c10 msgr2=0x7f2d7c038820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:22.206 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.182+0000 7f2d677fe640 1 -- 172.21.15.130:0/1017922824 shutdown_connections 2024-06-11T17:18:22.206 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.182+0000 7f2d677fe640 1 -- 172.21.15.130:0/1017922824 wait complete. 2024-06-11T17:18:22.207 INFO:teuthology.orchestra.run.smithi130.stdout:60129542147 2024-06-11T17:18:22.207 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-06-11T17:18:22.208 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.190+0000 7fc5ff59e640 1 -- 172.21.15.130:0/1092126060 --> v2:172.21.15.172:6808/1734469189 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc5e4005bb0 con 0x7fc5e4001640 2024-06-11T17:18:22.208 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.190+0000 7fc5eeffd640 1 -- 172.21.15.130:0/1092126060 <== osd.6 v2:172.21.15.172:6808/1734469189 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc5e4005bb0 con 0x7fc5e4001640 2024-06-11T17:18:22.209 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.194+0000 7fc5ff59e640 1 -- 172.21.15.130:0/1092126060 >> v2:172.21.15.172:6808/1734469189 conn(0x7fc5e4001640 msgr2=0x7fc5e4003b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.209 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.194+0000 7fc5ff59e640 1 --2- 172.21.15.130:0/1092126060 >> v2:172.21.15.172:6808/1734469189 conn(0x7fc5e4001640 0x7fc5e4003b00 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.209 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.194+0000 7fc5ff59e640 1 -- 172.21.15.130:0/1092126060 >> v2:172.21.15.130:6816/3863300924 conn(0x7fc5e0070e30 msgr2=0x7fc5e00732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.209 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.194+0000 7fc5ff59e640 1 --2- 172.21.15.130:0/1092126060 >> v2:172.21.15.130:6816/3863300924 conn(0x7fc5e0070e30 0x7fc5e00732f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc5f80c4c70 tx=0x7fc5f40091c0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.209 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.194+0000 7fc5ff59e640 1 -- 172.21.15.130:0/1092126060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f80371d0 msgr2=0x7fc5f802e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.209 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.194+0000 7fc5ff59e640 1 --2- 172.21.15.130:0/1092126060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f80371d0 0x7fc5f802e9b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc60007b450 tx=0x7fc600097110 comp rx=0 tx=0).stop 2024-06-11T17:18:22.209 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.194+0000 7fc60498a640 1 -- 172.21.15.130:0/1092126060 reap_dead start 2024-06-11T17:18:22.209 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.194+0000 7fc5ff59e640 1 -- 172.21.15.130:0/1092126060 shutdown_connections 2024-06-11T17:18:22.210 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.194+0000 7fc5ff59e640 1 -- 172.21.15.130:0/1092126060 >> 172.21.15.130:0/1092126060 conn(0x7fc5f803a400 msgr2=0x7fc5f80bc030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:22.210 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.194+0000 7fc5ff59e640 1 -- 172.21.15.130:0/1092126060 shutdown_connections 2024-06-11T17:18:22.210 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.194+0000 7fc5ff59e640 1 -- 172.21.15.130:0/1092126060 wait complete. 2024-06-11T17:18:22.210 INFO:teuthology.orchestra.run.smithi130.stdout:55834574850 2024-06-11T17:18:22.211 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-06-11T17:18:22.211 INFO:teuthology.orchestra.run.smithi130.stdout:55834574852 2024-06-11T17:18:22.212 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-06-11T17:18:22.212 INFO:teuthology.orchestra.run.smithi130.stdout:60129542148 2024-06-11T17:18:22.213 INFO:teuthology.orchestra.run.smithi130.stdout:60129542148 2024-06-11T17:18:22.213 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-06-11T17:18:22.214 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-06-11T17:18:22.215 INFO:teuthology.orchestra.run.smithi130.stdout:60129542147 2024-06-11T17:18:22.215 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-06-11T17:18:22.216 INFO:teuthology.orchestra.run.smithi130.stdout:60129542149 2024-06-11T17:18:22.216 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-06-11T17:18:22.218 INFO:teuthology.orchestra.run.smithi130.stdout:55834574851 2024-06-11T17:18:22.219 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-06-11T17:18:22.372 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.374+0000 7f050f7a1640 1 Processor -- start 2024-06-11T17:18:22.373 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.374+0000 7f050f7a1640 1 -- start start 2024-06-11T17:18:22.373 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.374+0000 7f050f7a1640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05080ac530 0x7f050813bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.373 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.374+0000 7f050f7a1640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f05080ab250 0x7f050813c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.373 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.374+0000 7f050f7a1640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f05080adfa0 0x7f05080ae3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.373 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.374+0000 7f050f7a1640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f05080ac910 con 0x7f05080ab250 2024-06-11T17:18:22.373 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.374+0000 7f050f7a1640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f050813c680 con 0x7f05080adfa0 2024-06-11T17:18:22.373 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.374+0000 7f050f7a1640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f05080abb70 con 0x7f05080ac530 2024-06-11T17:18:22.374 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.374+0000 7f050cd3c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f05080ab250 0x7f050813c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.374 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.374+0000 7f050cd3c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f05080ab250 0x7f050813c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38468/0 (socket says 172.21.15.130:38468) 2024-06-11T17:18:22.374 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.374+0000 7f050cd3c640 1 -- 172.21.15.130:0/143650816 learned_addr learned my addr 172.21.15.130:0/143650816 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:22.374 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.374+0000 7f050d53d640 1 --2- 172.21.15.130:0/143650816 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05080ac530 0x7f050813bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.374 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.374+0000 7f050cd3c640 1 -- 172.21.15.130:0/143650816 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05080ac530 msgr2=0x7f050813bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:22.374 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.374+0000 7f050cd3c640 1 --2- 172.21.15.130:0/143650816 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05080ac530 0x7f050813bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.375 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.374+0000 7f050cd3c640 1 -- 172.21.15.130:0/143650816 >> v2:172.21.15.172:3300/0 conn(0x7f05080adfa0 msgr2=0x7f05080ae3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-11T17:18:22.375 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.374+0000 7f050cd3c640 1 --2- 172.21.15.130:0/143650816 >> v2:172.21.15.172:3300/0 conn(0x7f05080adfa0 0x7f05080ae3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.375 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.374+0000 7f050cd3c640 1 -- 172.21.15.130:0/143650816 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05080ad9f0 con 0x7f05080ab250 2024-06-11T17:18:22.377 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.378+0000 7f050cd3c640 1 --2- 172.21.15.130:0/143650816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05080ab250 0x7f050813c140 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0508074490 tx=0x7f050001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d536559bef86fe49 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.377 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.378+0000 7f04fffff640 1 -- 172.21.15.130:0/143650816 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05000ad070 con 0x7f05080ab250 2024-06-11T17:18:22.377 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.378+0000 7f04fffff640 1 -- 172.21.15.130:0/143650816 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05000a7da0 con 0x7f05080ab250 2024-06-11T17:18:22.377 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.378+0000 7f04fffff640 1 -- 172.21.15.130:0/143650816 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050000be60 con 0x7f05080ab250 2024-06-11T17:18:22.378 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.378+0000 7f050f7a1640 1 -- 172.21.15.130:0/143650816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05080ab250 msgr2=0x7f050813c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.378 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.378+0000 7f050f7a1640 1 --2- 172.21.15.130:0/143650816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05080ab250 0x7f050813c140 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0508074490 tx=0x7f050001ecf0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.378 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.378+0000 7f050f7a1640 1 -- 172.21.15.130:0/143650816 shutdown_connections 2024-06-11T17:18:22.378 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.378+0000 7f050f7a1640 1 --2- 172.21.15.130:0/143650816 >> v2:172.21.15.172:3300/0 conn(0x7f05080adfa0 0x7f05080ae3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.379 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.378+0000 7f050f7a1640 1 --2- 172.21.15.130:0/143650816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05080ab250 0x7f050813c140 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0508074490 tx=0x7f050001ecf0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.379 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.378+0000 7f050f7a1640 1 --2- 172.21.15.130:0/143650816 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05080ac530 0x7f050813bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.379 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.378+0000 7f050f7a1640 1 -- 172.21.15.130:0/143650816 >> 172.21.15.130:0/143650816 conn(0x7f05080b4ab0 msgr2=0x7f05080b4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:22.379 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.382+0000 7f050f7a1640 1 -- 172.21.15.130:0/143650816 shutdown_connections 2024-06-11T17:18:22.379 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.382+0000 7f050f7a1640 1 -- 172.21.15.130:0/143650816 wait complete. 2024-06-11T17:18:22.380 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.382+0000 7f050f7a1640 1 Processor -- start 2024-06-11T17:18:22.381 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.382+0000 7f050f7a1640 1 -- start start 2024-06-11T17:18:22.381 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.382+0000 7f050f7a1640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05080ac530 0x7f050813f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.381 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.382+0000 7f050f7a1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05080adfa0 0x7f0508147d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.382+0000 7f050f7a1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05081e2c10 0x7f05081460d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.382+0000 7f050f7a1640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0508142b40 con 0x7f05081e2c10 2024-06-11T17:18:22.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.382+0000 7f050f7a1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f05081429c0 con 0x7f05080adfa0 2024-06-11T17:18:22.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.382+0000 7f050f7a1640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f0508142cc0 con 0x7f05080ac530 2024-06-11T17:18:22.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.382+0000 7f050d53d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05080ac530 0x7f050813f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.382+0000 7f050d53d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05080ac530 0x7f050813f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:53610/0 (socket says 172.21.15.130:53610) 2024-06-11T17:18:22.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.382+0000 7f050d53d640 1 -- 172.21.15.130:0/1231855691 learned_addr learned my addr 172.21.15.130:0/1231855691 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:22.383 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.382+0000 7f050cd3c640 1 --2- 172.21.15.130:0/1231855691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05080adfa0 0x7f0508147d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.383 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.382+0000 7f050d53d640 1 -- 172.21.15.130:0/1231855691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05080adfa0 msgr2=0x7f0508147d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.383 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.382+0000 7f050d53d640 1 --2- 172.21.15.130:0/1231855691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05080adfa0 0x7f0508147d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.383 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.382+0000 7f050d53d640 1 -- 172.21.15.130:0/1231855691 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05081e2c10 msgr2=0x7f05081460d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-11T17:18:22.383 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.382+0000 7f050dd3e640 1 --2- 172.21.15.130:0/1231855691 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05081e2c10 0x7f05081460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.383 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.382+0000 7f050d53d640 1 --2- 172.21.15.130:0/1231855691 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05081e2c10 0x7f05081460d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.383 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.382+0000 7f050d53d640 1 -- 172.21.15.130:0/1231855691 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05081e30a0 con 0x7f05080ac530 2024-06-11T17:18:22.384 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.382+0000 7f050cd3c640 1 --2- 172.21.15.130:0/1231855691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05080adfa0 0x7f0508147d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-11T17:18:22.384 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.382+0000 7f050dd3e640 1 --2- 172.21.15.130:0/1231855691 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05081e2c10 0x7f05081460d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-11T17:18:22.384 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.386+0000 7f050d53d640 1 --2- 172.21.15.130:0/1231855691 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05080ac530 0x7f050813f340 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f050400e960 tx=0x7f050400ee20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.384 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.386+0000 7f04fdffb640 1 -- 172.21.15.130:0/1231855691 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0504017070 con 0x7f05080ac530 2024-06-11T17:18:22.386 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.386+0000 7f050f7a1640 1 -- 172.21.15.130:0/1231855691 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0508147340 con 0x7f05080ac530 2024-06-11T17:18:22.386 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.386+0000 7f050f7a1640 1 -- 172.21.15.130:0/1231855691 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0508146610 con 0x7f05080ac530 2024-06-11T17:18:22.386 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.386+0000 7f050f7a1640 1 -- 172.21.15.130:0/1231855691 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05080ae3d0 con 0x7f05080ac530 2024-06-11T17:18:22.386 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.386+0000 7f04fdffb640 1 -- 172.21.15.130:0/1231855691 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f050400ca00 con 0x7f05080ac530 2024-06-11T17:18:22.386 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.386+0000 7f04fdffb640 1 -- 172.21.15.130:0/1231855691 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050400cdb0 con 0x7f05080ac530 2024-06-11T17:18:22.386 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.386+0000 7f04fdffb640 1 -- 172.21.15.130:0/1231855691 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f050401a070 con 0x7f05080ac530 2024-06-11T17:18:22.388 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7f786024e640 1 Processor -- start 2024-06-11T17:18:22.388 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7f786024e640 1 -- start start 2024-06-11T17:18:22.389 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.386+0000 7f04fdffb640 1 --2- 172.21.15.130:0/1231855691 >> v2:172.21.15.130:6816/3863300924 conn(0x7f04ec070e90 0x7f04ec073350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.389 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7f04fdffb640 1 -- 172.21.15.130:0/1231855691 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 4090+0+0 (secure 0 0 0) 0x7f0504090b40 con 0x7f05080ac530 2024-06-11T17:18:22.389 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7f050cd3c640 1 --2- 172.21.15.130:0/1231855691 >> v2:172.21.15.130:6816/3863300924 conn(0x7f04ec070e90 0x7f04ec073350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.389 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7f050cd3c640 1 --2- 172.21.15.130:0/1231855691 >> v2:172.21.15.130:6816/3863300924 conn(0x7f04ec070e90 0x7f04ec073350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f05000b2000 tx=0x7f05000a9070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.389 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7fdb37add640 1 Processor -- start 2024-06-11T17:18:22.389 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7fdb37add640 1 -- start start 2024-06-11T17:18:22.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7fdb37add640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdb300ac530 0x7fdb3013bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7fb33aa91640 1 Processor -- start 2024-06-11T17:18:22.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7fb33aa91640 1 -- start start 2024-06-11T17:18:22.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7f786024e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f78580aadf0 0x7f78580ae250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.391 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7f786024e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78580ab410 con 0x7f78580abe30 2024-06-11T17:18:22.391 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7f786024e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78580ae790 con 0x7f78580ac210 2024-06-11T17:18:22.391 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7f786024e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f78580aec90 con 0x7f78580aadf0 2024-06-11T17:18:22.391 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7f785dfea640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f78580abe30 0x7f78581464c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:35382/0 (socket says 172.21.15.130:35382) 2024-06-11T17:18:22.391 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7f785dfea640 1 -- 172.21.15.130:0/297501038 learned_addr learned my addr 172.21.15.130:0/297501038 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-06-11T17:18:22.391 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7f785e7eb640 1 --2- 172.21.15.130:0/297501038 >> v2:172.21.15.172:3300/0 conn(0x7f78580aadf0 0x7f78580ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.391 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7fb33aa91640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb334142830 0x7fb3341414e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.391 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7fb33aa91640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb3340b0950 0x7fb334149b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.391 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7fb33aa91640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3340ace30 con 0x7fb334142c10 2024-06-11T17:18:22.392 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7fb33aa91640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fb3340ab3e0 con 0x7fb334142830 2024-06-11T17:18:22.392 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7fb33aa91640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fb3340ad0a0 con 0x7fb3340b0950 2024-06-11T17:18:22.392 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7f785cfe8640 1 -- 172.21.15.130:0/297501038 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2974769272 0 0) 0x7f78580ab410 con 0x7f78580abe30 2024-06-11T17:18:22.392 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7f785cfe8640 1 -- 172.21.15.130:0/297501038 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7844003530 con 0x7f78580abe30 2024-06-11T17:18:22.392 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7f4204c0e640 1 Processor -- start 2024-06-11T17:18:22.392 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7f4204c0e640 1 -- start start 2024-06-11T17:18:22.392 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7f4204c0e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f41f8034700 0x7f41f80cf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.392 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7f41ff7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f41f8034700 0x7f41f80cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.393 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7f41ff7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f41f8034700 0x7f41f80cf800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38472/0 (socket says 172.21.15.130:38472) 2024-06-11T17:18:22.393 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7f41ff7fe640 1 -- 172.21.15.130:0/1864282667 learned_addr learned my addr 172.21.15.130:0/1864282667 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:22.393 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7f4204c0e640 1 --2- 172.21.15.130:0/1864282667 >> v2:172.21.15.172:3300/0 conn(0x7f41f80c8840 0x7f41f80c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.393 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7f4204c0e640 1 -- 172.21.15.130:0/1864282667 --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41f802bc80 con 0x7f41f80cedc0 2024-06-11T17:18:22.393 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7f4204c0e640 1 -- 172.21.15.130:0/1864282667 --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f41f80cfd40 con 0x7f41f8034700 2024-06-11T17:18:22.393 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7f4204c0e640 1 -- 172.21.15.130:0/1864282667 --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f41f8034ae0 con 0x7f41f80c8840 2024-06-11T17:18:22.393 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7f41fffff640 1 --2- 172.21.15.130:0/1864282667 >> v2:172.21.15.172:3300/0 conn(0x7f41f80c8840 0x7f41f80c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.393 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f41ff7fe640 1 -- 172.21.15.130:0/1864282667 >> v2:172.21.15.172:3300/0 conn(0x7f41f80c8840 msgr2=0x7f41f80c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:22.393 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f41ff7fe640 1 --2- 172.21.15.130:0/1864282667 >> v2:172.21.15.172:3300/0 conn(0x7f41f80c8840 0x7f41f80c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.393 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f41ff7fe640 1 -- 172.21.15.130:0/1864282667 >> v1:172.21.15.172:6789/0 conn(0x7f41f80cedc0 legacy=0x7f41f80cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.393 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f41ff7fe640 1 -- 172.21.15.130:0/1864282667 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f802bf60 con 0x7f41f8034700 2024-06-11T17:18:22.394 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7fb33a290640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb3340b0950 0x7fb334149b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.394 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7fb33928e640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fb334142c10 0x7fb334141a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:35398/0 (socket says 172.21.15.130:35398) 2024-06-11T17:18:22.394 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7fb33928e640 1 -- 172.21.15.130:0/462252720 learned_addr learned my addr 172.21.15.130:0/462252720 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-06-11T17:18:22.394 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7f785e7eb640 1 -- 172.21.15.130:0/297501038 >> v1:172.21.15.172:6789/0 conn(0x7f78580ac210 legacy=0x7f78580adb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.394 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7f785e7eb640 1 -- 172.21.15.130:0/297501038 >> v1:172.21.15.130:6789/0 conn(0x7f78580abe30 legacy=0x7f78581464c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.394 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7f785e7eb640 1 -- 172.21.15.130:0/297501038 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7858146bd0 con 0x7f78580aadf0 2024-06-11T17:18:22.394 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7fdb37add640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdb300ab250 0x7fdb3013c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.394 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7fdb37add640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb3013c680 con 0x7fdb300af0b0 2024-06-11T17:18:22.395 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7fdb37add640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fdb300ac910 con 0x7fdb300ac530 2024-06-11T17:18:22.395 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7fdb37add640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fdb300abb70 con 0x7fdb300ab250 2024-06-11T17:18:22.395 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.390+0000 7fdb35879640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdb300ac530 0x7fdb3013bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.395 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7fdb35879640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdb300ac530 0x7fdb3013bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.130:57262/0 (socket says 172.21.15.130:57262) 2024-06-11T17:18:22.395 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7fdb35879640 1 -- 172.21.15.130:0/3114027733 learned_addr learned my addr 172.21.15.130:0/3114027733 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:22.395 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7fb339a8f640 1 --2- 172.21.15.130:0/462252720 >> v2:172.21.15.172:3300/0 conn(0x7fb334142830 0x7fb3341414e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.395 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7fdb35078640 1 --2- 172.21.15.130:0/3114027733 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdb300ab250 0x7fdb3013c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.396 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f0465bfd640 1 Processor -- start 2024-06-11T17:18:22.396 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f41fffff640 1 --2- 172.21.15.130:0/1864282667 >> v2:172.21.15.172:3300/0 conn(0x7f41f80c8840 0x7f41f80c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-11T17:18:22.396 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f41ff7fe640 1 --2- 172.21.15.130:0/1864282667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41f8034700 0x7f41f80cf800 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f41f8033200 tx=0x7f41f401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8fda06462672935 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.396 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7fb33a290640 1 -- 172.21.15.130:0/462252720 >> v2:172.21.15.172:3300/0 conn(0x7fb334142830 msgr2=0x7fb3341414e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:22.396 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7fb33a290640 1 --2- 172.21.15.130:0/462252720 >> v2:172.21.15.172:3300/0 conn(0x7fb334142830 0x7fb3341414e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.396 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7fb33a290640 1 -- 172.21.15.130:0/462252720 >> v1:172.21.15.130:6789/0 conn(0x7fb334142c10 legacy=0x7fb334141a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.397 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f0465bfd640 1 -- start start 2024-06-11T17:18:22.397 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f0465bfd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0458039210 0x7f0458035770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.397 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f0465bfd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f04580cb240 0x7f04580c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.397 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f0465bfd640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04580371f0 con 0x7f04580c49a0 2024-06-11T17:18:22.397 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f0465bfd640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f04580395f0 con 0x7f04580cb240 2024-06-11T17:18:22.397 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f0465bfd640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f0458035e40 con 0x7f0458039210 2024-06-11T17:18:22.397 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f04653fc640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f04580cb240 0x7f04580c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.397 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f04653fc640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f04580cb240 0x7f04580c4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38480/0 (socket says 172.21.15.130:38480) 2024-06-11T17:18:22.397 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f04653fc640 1 -- 172.21.15.130:0/3516177794 learned_addr learned my addr 172.21.15.130:0/3516177794 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:22.397 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f04653fc640 1 -- 172.21.15.130:0/3516177794 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0458039210 msgr2=0x7f0458035770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:22.397 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f04653fc640 1 --2- 172.21.15.130:0/3516177794 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0458039210 0x7f0458035770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.398 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f04653fc640 1 -- 172.21.15.130:0/3516177794 >> v1:172.21.15.172:6789/0 conn(0x7f04580c49a0 legacy=0x7f04580cab30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-11T17:18:22.398 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f04653fc640 1 -- 172.21.15.130:0/3516177794 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0458035290 con 0x7f04580cb240 2024-06-11T17:18:22.398 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f785e7eb640 1 --2- 172.21.15.130:0/297501038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78580aadf0 0x7f78580ae250 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7850009d90 tx=0x7f785001c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31ec3b1dd08a272e server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.398 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f785cfe8640 1 -- 172.21.15.130:0/297501038 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78500b2070 con 0x7f78580aadf0 2024-06-11T17:18:22.398 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f785cfe8640 1 -- 172.21.15.130:0/297501038 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78500a5780 con 0x7f78580aadf0 2024-06-11T17:18:22.398 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f785cfe8640 1 -- 172.21.15.130:0/297501038 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78500a5b50 con 0x7f78580aadf0 2024-06-11T17:18:22.398 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f786024e640 1 -- 172.21.15.130:0/297501038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78580aadf0 msgr2=0x7f78580ae250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.398 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f786024e640 1 --2- 172.21.15.130:0/297501038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78580aadf0 0x7f78580ae250 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7850009d90 tx=0x7f785001c8c0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.398 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f786024e640 1 -- 172.21.15.130:0/297501038 shutdown_connections 2024-06-11T17:18:22.399 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f786024e640 1 --2- 172.21.15.130:0/297501038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78580aadf0 0x7f78580ae250 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.399 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f786024e640 1 -- 172.21.15.130:0/297501038 >> 172.21.15.130:0/297501038 conn(0x7f78580b4ab0 msgr2=0x7f78580b4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:22.399 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f786024e640 1 -- 172.21.15.130:0/297501038 shutdown_connections 2024-06-11T17:18:22.399 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f786024e640 1 -- 172.21.15.130:0/297501038 wait complete. 2024-06-11T17:18:22.399 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f4aaa72c640 1 Processor -- start 2024-06-11T17:18:22.399 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f4aaa72c640 1 -- start start 2024-06-11T17:18:22.399 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f4aaa72c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4a9c007c70 0x7f4a9c02ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.399 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f4aaa72c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4a9c02a1a0 0x7f4a9c0c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.399 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f4aaa72c640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a9c0cc240 con 0x7f4a9c0c91a0 2024-06-11T17:18:22.399 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f4aaa72c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f4a9c008050 con 0x7f4a9c007c70 2024-06-11T17:18:22.399 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f4aaa72c640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f4a9c02c300 con 0x7f4a9c02a1a0 2024-06-11T17:18:22.400 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f4aa972a640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4a9c007c70 0x7f4a9c02ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.400 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f4aa972a640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4a9c007c70 0x7f4a9c02ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38488/0 (socket says 172.21.15.130:38488) 2024-06-11T17:18:22.400 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f4aa972a640 1 -- 172.21.15.130:0/1581000512 learned_addr learned my addr 172.21.15.130:0/1581000512 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:22.400 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f4aa8f29640 1 --2- 172.21.15.130:0/1581000512 >> v2:172.21.15.172:3300/0 conn(0x7f4a9c02a1a0 0x7f4a9c0c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.400 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f4aa972a640 1 -- 172.21.15.130:0/1581000512 >> v2:172.21.15.172:3300/0 conn(0x7f4a9c02a1a0 msgr2=0x7f4a9c0c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:22.400 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f4aa972a640 1 --2- 172.21.15.130:0/1581000512 >> v2:172.21.15.172:3300/0 conn(0x7f4a9c02a1a0 0x7f4a9c0c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.400 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f4aa972a640 1 -- 172.21.15.130:0/1581000512 >> v1:172.21.15.172:6789/0 conn(0x7f4a9c0c91a0 legacy=0x7f4a9c0cbb30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-11T17:18:22.400 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f4aa972a640 1 -- 172.21.15.130:0/1581000512 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a9c0cc410 con 0x7f4a9c007c70 2024-06-11T17:18:22.400 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7f4aa8f29640 1 --2- 172.21.15.130:0/1581000512 >> v2:172.21.15.172:3300/0 conn(0x7f4a9c02a1a0 0x7f4a9c0c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-11T17:18:22.400 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7fdb35879640 1 -- 172.21.15.130:0/3114027733 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdb300ab250 msgr2=0x7fdb3013c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:22.400 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7fdb35879640 1 --2- 172.21.15.130:0/3114027733 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdb300ab250 0x7fdb3013c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.401 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7fdb35879640 1 -- 172.21.15.130:0/3114027733 >> v1:172.21.15.130:6789/0 conn(0x7fdb300af0b0 legacy=0x7fdb30141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.401 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.394+0000 7fdb35879640 1 -- 172.21.15.130:0/3114027733 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb300ad9f0 con 0x7fdb300ac530 2024-06-11T17:18:22.401 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7fb33a290640 1 -- 172.21.15.130:0/462252720 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3340ab800 con 0x7fb3340b0950 2024-06-11T17:18:22.401 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7fdb35879640 1 --2- 172.21.15.130:0/3114027733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb300ac530 0x7fdb3013bc00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdb20009870 tx=0x7fdb2001c4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b1d6ecf0636a45c server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.402 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f41fe7fc640 1 -- 172.21.15.130:0/1864282667 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f40b1070 con 0x7f41f8034700 2024-06-11T17:18:22.402 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f41fe7fc640 1 -- 172.21.15.130:0/1864282667 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41f40ac410 con 0x7f41f8034700 2024-06-11T17:18:22.402 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7fdb34877640 1 -- 172.21.15.130:0/3114027733 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb200b0070 con 0x7fdb300ac530 2024-06-11T17:18:22.402 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f4aa972a640 1 --2- 172.21.15.130:0/1581000512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a9c007c70 0x7f4a9c02ab10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c02b8a0 tx=0x7f4a9401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acb7eba68ac30ffc server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.402 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f786024e640 1 Processor -- start 2024-06-11T17:18:22.403 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f4a9bfff640 1 -- 172.21.15.130:0/1581000512 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a940b0070 con 0x7f4a9c007c70 2024-06-11T17:18:22.403 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f4204c0e640 1 -- 172.21.15.130:0/1864282667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41f8034700 msgr2=0x7f41f80cf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.403 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f4204c0e640 1 --2- 172.21.15.130:0/1864282667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41f8034700 0x7f41f80cf800 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f41f8033200 tx=0x7f41f401c3b0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.403 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f786024e640 1 -- start start 2024-06-11T17:18:22.404 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f4a9bfff640 1 -- 172.21.15.130:0/1581000512 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a940ab600 con 0x7f4a9c007c70 2024-06-11T17:18:22.404 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f4a9bfff640 1 -- 172.21.15.130:0/1581000512 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a940ab9d0 con 0x7f4a9c007c70 2024-06-11T17:18:22.404 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7fdb34877640 1 -- 172.21.15.130:0/3114027733 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb200ab600 con 0x7fdb300ac530 2024-06-11T17:18:22.404 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7fdb34877640 1 -- 172.21.15.130:0/3114027733 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb200aba10 con 0x7fdb300ac530 2024-06-11T17:18:22.404 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f4204c0e640 1 -- 172.21.15.130:0/1864282667 shutdown_connections 2024-06-11T17:18:22.404 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f4204c0e640 1 --2- 172.21.15.130:0/1864282667 >> v2:172.21.15.172:3300/0 conn(0x7f41f80c8840 0x7f41f80c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.404 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f4204c0e640 1 --2- 172.21.15.130:0/1864282667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41f8034700 0x7f41f80cf800 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f41f8033200 tx=0x7f41f401c3b0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.404 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f4204c0e640 1 -- 172.21.15.130:0/1864282667 >> 172.21.15.130:0/1864282667 conn(0x7f41f8005a10 msgr2=0x7f41f8005df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:22.405 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f786024e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78580aadf0 0x7f78581dde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.405 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f786024e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78580abe30 0x7f785814ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.405 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f786024e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78580ac210 0x7f78581eae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.405 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f786024e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7858155330 con 0x7f78580ac210 2024-06-11T17:18:22.405 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f786024e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f78581551b0 con 0x7f78580aadf0 2024-06-11T17:18:22.405 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f786024e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f78581554b0 con 0x7f78580abe30 2024-06-11T17:18:22.405 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f785d7e9640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78580abe30 0x7f785814ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.406 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f785e7eb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78580ac210 0x7f78581eae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.406 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f785d7e9640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78580abe30 0x7f785814ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:53648/0 (socket says 172.21.15.130:53648) 2024-06-11T17:18:22.406 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f785e7eb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78580ac210 0x7f78581eae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38502/0 (socket says 172.21.15.130:38502) 2024-06-11T17:18:22.406 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f785d7e9640 1 -- 172.21.15.130:0/2031324869 learned_addr learned my addr 172.21.15.130:0/2031324869 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:22.406 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f04fdffb640 1 -- 172.21.15.130:0/1231855691 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7f050405d470 con 0x7f05080ac530 2024-06-11T17:18:22.406 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f785dfea640 1 --2- 172.21.15.130:0/2031324869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78580aadf0 0x7f78581dde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.407 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7fdb37add640 1 -- 172.21.15.130:0/3114027733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb300ac530 msgr2=0x7fdb3013bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.407 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7fdb37add640 1 --2- 172.21.15.130:0/3114027733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb300ac530 0x7fdb3013bc00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdb20009870 tx=0x7fdb2001c4c0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.407 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f4aaa72c640 1 -- 172.21.15.130:0/1581000512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a9c007c70 msgr2=0x7f4a9c02ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.407 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f4aaa72c640 1 --2- 172.21.15.130:0/1581000512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a9c007c70 0x7f4a9c02ab10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c02b8a0 tx=0x7f4a9401c470 comp rx=0 tx=0).stop 2024-06-11T17:18:22.407 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f4204c0e640 1 -- 172.21.15.130:0/1864282667 shutdown_connections 2024-06-11T17:18:22.407 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f4204c0e640 1 -- 172.21.15.130:0/1864282667 wait complete. 2024-06-11T17:18:22.408 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f785d7e9640 1 -- 172.21.15.130:0/2031324869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78580aadf0 msgr2=0x7f78581dde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.408 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f785d7e9640 1 --2- 172.21.15.130:0/2031324869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78580aadf0 0x7f78581dde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.408 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f785d7e9640 1 -- 172.21.15.130:0/2031324869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78580ac210 msgr2=0x7f78581eae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.408 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f785d7e9640 1 --2- 172.21.15.130:0/2031324869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78580ac210 0x7f78581eae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.408 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f785d7e9640 1 -- 172.21.15.130:0/2031324869 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78581de920 con 0x7f78580abe30 2024-06-11T17:18:22.408 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f4aaa72c640 1 -- 172.21.15.130:0/1581000512 shutdown_connections 2024-06-11T17:18:22.408 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f4aaa72c640 1 --2- 172.21.15.130:0/1581000512 >> v2:172.21.15.172:3300/0 conn(0x7f4a9c02a1a0 0x7f4a9c0c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.408 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f4aaa72c640 1 --2- 172.21.15.130:0/1581000512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a9c007c70 0x7f4a9c02ab10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.408 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f4aaa72c640 1 -- 172.21.15.130:0/1581000512 >> 172.21.15.130:0/1581000512 conn(0x7f4a9c006b20 msgr2=0x7f4a9c006f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:22.409 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7fdb37add640 1 -- 172.21.15.130:0/3114027733 shutdown_connections 2024-06-11T17:18:22.409 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7fdb37add640 1 --2- 172.21.15.130:0/3114027733 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdb300ab250 0x7fdb3013c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.409 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7fdb37add640 1 --2- 172.21.15.130:0/3114027733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb300ac530 0x7fdb3013bc00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.409 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7fdb37add640 1 -- 172.21.15.130:0/3114027733 >> 172.21.15.130:0/3114027733 conn(0x7fdb300b4ab0 msgr2=0x7fdb300b4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:22.409 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7fdb37add640 1 -- 172.21.15.130:0/3114027733 shutdown_connections 2024-06-11T17:18:22.409 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7fdb37add640 1 -- 172.21.15.130:0/3114027733 wait complete. 2024-06-11T17:18:22.409 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f4aaa72c640 1 -- 172.21.15.130:0/1581000512 shutdown_connections 2024-06-11T17:18:22.410 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f4aaa72c640 1 -- 172.21.15.130:0/1581000512 wait complete. 2024-06-11T17:18:22.410 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f785d7e9640 1 --2- 172.21.15.130:0/2031324869 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78580abe30 0x7f785814ae40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f784800c420 tx=0x7f784800c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.410 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f784e7fc640 1 -- 172.21.15.130:0/2031324869 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7848017070 con 0x7f78580abe30 2024-06-11T17:18:22.410 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.398+0000 7f784e7fc640 1 -- 172.21.15.130:0/2031324869 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78480052d0 con 0x7f78580abe30 2024-06-11T17:18:22.411 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7f4204c0e640 1 Processor -- start 2024-06-11T17:18:22.411 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7f4204c0e640 1 -- start start 2024-06-11T17:18:22.411 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7f784e7fc640 1 -- 172.21.15.130:0/2031324869 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78480054c0 con 0x7f78580abe30 2024-06-11T17:18:22.411 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7f786024e640 1 -- 172.21.15.130:0/2031324869 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f785806f0d0 con 0x7f78580abe30 2024-06-11T17:18:22.411 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7f786024e640 1 -- 172.21.15.130:0/2031324869 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f78581eb340 con 0x7f78580abe30 2024-06-11T17:18:22.412 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7f4aaa72c640 1 Processor -- start 2024-06-11T17:18:22.412 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fdb37add640 1 Processor -- start 2024-06-11T17:18:22.412 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fdb37add640 1 -- start start 2024-06-11T17:18:22.412 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fb33a290640 1 --2- 172.21.15.130:0/462252720 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb3340b0950 0x7fb334149b10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb33000ba60 tx=0x7fb33001e9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48755ba87fd50921 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.413 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7f4204c0e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41f80c8840 0x7f41f8167940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.413 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7f4204c0e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41f80cedc0 0x7f41f80d3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.413 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7f4204c0e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f41f80d3470 0x7f41f80d4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.413 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7f4204c0e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f41f80d8af0 con 0x7f41f80c8840 2024-06-11T17:18:22.413 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7f4204c0e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f41f80d8970 con 0x7f41f80cedc0 2024-06-11T17:18:22.413 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7f4204c0e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f41f80d8c70 con 0x7f41f80d3470 2024-06-11T17:18:22.413 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7f41ff7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41f80c8840 0x7f41f8167940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.413 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7f41ff7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41f80c8840 0x7f41f8167940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38516/0 (socket says 172.21.15.130:38516) 2024-06-11T17:18:22.413 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7f41ff7fe640 1 -- 172.21.15.130:0/4234652189 learned_addr learned my addr 172.21.15.130:0/4234652189 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:22.413 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7f41feffd640 1 --2- 172.21.15.130:0/4234652189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41f80cedc0 0x7f41f80d3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.414 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fdb37add640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb300ac530 0x7fdb3006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.414 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fdb37add640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb300af0b0 0x7fdb3006f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.414 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fdb37add640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdb3013d500 0x7fdb3013d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.414 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fdb37add640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdb300ae440 con 0x7fdb300ac530 2024-06-11T17:18:22.414 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fdb37add640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdb300ae2c0 con 0x7fdb300af0b0 2024-06-11T17:18:22.414 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fdb37add640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fdb300ae5c0 con 0x7fdb3013d500 2024-06-11T17:18:22.414 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fdb35879640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb300ac530 0x7fdb3006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.414 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fdb35879640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb300ac530 0x7fdb3006f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38522/0 (socket says 172.21.15.130:38522) 2024-06-11T17:18:22.414 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fdb35879640 1 -- 172.21.15.130:0/2590027127 learned_addr learned my addr 172.21.15.130:0/2590027127 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:22.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7f41fffff640 1 --2- 172.21.15.130:0/4234652189 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f41f80d3470 0x7f41f80d4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fdb3607a640 1 --2- 172.21.15.130:0/2590027127 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdb3013d500 0x7fdb3013d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fdb35879640 1 -- 172.21.15.130:0/2590027127 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdb3013d500 msgr2=0x7fdb3013d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fdb35879640 1 --2- 172.21.15.130:0/2590027127 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdb3013d500 0x7fdb3013d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fdb35879640 1 -- 172.21.15.130:0/2590027127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb300af0b0 msgr2=0x7fdb3006f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fdb35879640 1 --2- 172.21.15.130:0/2590027127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb300af0b0 0x7fdb3006f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fdb35879640 1 -- 172.21.15.130:0/2590027127 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb30071150 con 0x7fdb300ac530 2024-06-11T17:18:22.416 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7f41feffd640 1 -- 172.21.15.130:0/4234652189 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f41f80d3470 msgr2=0x7f41f80d4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.416 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7f41feffd640 1 --2- 172.21.15.130:0/4234652189 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f41f80d3470 0x7f41f80d4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.416 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7f41feffd640 1 -- 172.21.15.130:0/4234652189 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41f80c8840 msgr2=0x7f41f8167940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.416 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7f41feffd640 1 --2- 172.21.15.130:0/4234652189 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41f80c8840 0x7f41f8167940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.416 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fb338a8d640 1 -- 172.21.15.130:0/462252720 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3300b4070 con 0x7fb3340b0950 2024-06-11T17:18:22.417 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7f41feffd640 1 -- 172.21.15.130:0/4234652189 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f8008ff0 con 0x7f41f80cedc0 2024-06-11T17:18:22.417 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fb338a8d640 1 -- 172.21.15.130:0/462252720 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3300a7840 con 0x7fb3340b0950 2024-06-11T17:18:22.417 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fb338a8d640 1 -- 172.21.15.130:0/462252720 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3300a7c10 con 0x7fb3340b0950 2024-06-11T17:18:22.417 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fb33aa91640 1 -- 172.21.15.130:0/462252720 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb3340b0950 msgr2=0x7fb334149b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.417 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fb33aa91640 1 --2- 172.21.15.130:0/462252720 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb3340b0950 0x7fb334149b10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb33000ba60 tx=0x7fb33001e9b0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.417 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fdb35879640 1 --2- 172.21.15.130:0/2590027127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb300ac530 0x7fdb3006f040 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdb2001a0f0 tx=0x7fdb20019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.418 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fdb267fc640 1 -- 172.21.15.130:0/2590027127 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb200b9020 con 0x7fdb300ac530 2024-06-11T17:18:22.418 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7f41feffd640 1 --2- 172.21.15.130:0/4234652189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41f80cedc0 0x7f41f80d3e20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f41ec00c3c0 tx=0x7f41ec00c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.418 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fdb267fc640 1 -- 172.21.15.130:0/2590027127 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb200b1040 con 0x7fdb300ac530 2024-06-11T17:18:22.418 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fdb267fc640 1 -- 172.21.15.130:0/2590027127 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb200b0050 con 0x7fdb300ac530 2024-06-11T17:18:22.418 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7f04653fc640 1 --2- 172.21.15.130:0/3516177794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04580cb240 0x7f04580c4da0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f044c009870 tx=0x7f044c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9407750f9b11285d server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.419 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7f784e7fc640 1 -- 172.21.15.130:0/2031324869 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f784801a070 con 0x7f78580abe30 2024-06-11T17:18:22.419 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7f4aaa72c640 1 -- start start 2024-06-11T17:18:22.419 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7f4aaa72c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a9c007c70 0x7f4a9c0c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.420 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fb33aa91640 1 -- 172.21.15.130:0/462252720 shutdown_connections 2024-06-11T17:18:22.420 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fb33aa91640 1 --2- 172.21.15.130:0/462252720 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb3340b0950 0x7fb334149b10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.420 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fb33aa91640 1 --2- 172.21.15.130:0/462252720 >> v2:172.21.15.172:3300/0 conn(0x7fb334142830 0x7fb3341414e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.420 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fb33aa91640 1 -- 172.21.15.130:0/462252720 >> 172.21.15.130:0/462252720 conn(0x7fb33406c900 msgr2=0x7fb3340b46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:22.420 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fb33aa91640 1 -- 172.21.15.130:0/462252720 shutdown_connections 2024-06-11T17:18:22.420 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7f784e7fc640 1 --2- 172.21.15.130:0/2031324869 >> v2:172.21.15.130:6816/3863300924 conn(0x7f783c070d90 0x7f783c073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.420 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7f41ebfff640 1 -- 172.21.15.130:0/4234652189 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ec017070 con 0x7f41f80cedc0 2024-06-11T17:18:22.421 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7f785dfea640 1 --2- 172.21.15.130:0/2031324869 >> v2:172.21.15.130:6816/3863300924 conn(0x7f783c070d90 0x7f783c073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.421 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fdb37add640 1 -- 172.21.15.130:0/2590027127 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb300713c0 con 0x7fdb300ac530 2024-06-11T17:18:22.421 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fdb37add640 1 -- 172.21.15.130:0/2590027127 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb3013def0 con 0x7fdb300ac530 2024-06-11T17:18:22.421 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7fdb37add640 1 -- 172.21.15.130:0/2590027127 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb300aea20 con 0x7fdb300ac530 2024-06-11T17:18:22.422 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7f785dfea640 1 --2- 172.21.15.130:0/2031324869 >> v2:172.21.15.130:6816/3863300924 conn(0x7f783c070d90 0x7f783c073250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7854007fd0 tx=0x7f7854007240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.422 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7f784e7fc640 1 -- 172.21.15.130:0/2031324869 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 4090+0+0 (secure 0 0 0) 0x7f784808fd20 con 0x7f78580abe30 2024-06-11T17:18:22.422 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7f4204c0e640 1 -- 172.21.15.130:0/4234652189 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41f802cdc0 con 0x7f41f80cedc0 2024-06-11T17:18:22.422 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7f4204c0e640 1 -- 172.21.15.130:0/4234652189 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41f80d0a40 con 0x7f41f80cedc0 2024-06-11T17:18:22.422 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7f41ebfff640 1 -- 172.21.15.130:0/4234652189 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41ec0052d0 con 0x7f41f80cedc0 2024-06-11T17:18:22.422 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7f41ebfff640 1 -- 172.21.15.130:0/4234652189 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ec003800 con 0x7f41f80cedc0 2024-06-11T17:18:22.423 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.402+0000 7fb33aa91640 1 -- 172.21.15.130:0/462252720 wait complete. 2024-06-11T17:18:22.423 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7fb33aa91640 1 Processor -- start 2024-06-11T17:18:22.423 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7f4204c0e640 1 -- 172.21.15.130:0/4234652189 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41e0005090 con 0x7f41f80cedc0 2024-06-11T17:18:22.423 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7f045f7fe640 1 -- 172.21.15.130:0/3516177794 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c0b1070 con 0x7f04580cb240 2024-06-11T17:18:22.423 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7f045f7fe640 1 -- 172.21.15.130:0/3516177794 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f044c0ac630 con 0x7f04580cb240 2024-06-11T17:18:22.424 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7f045f7fe640 1 -- 172.21.15.130:0/3516177794 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c0a8050 con 0x7f04580cb240 2024-06-11T17:18:22.424 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7fb33aa91640 1 -- start start 2024-06-11T17:18:22.424 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7fb33aa91640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb3340b0950 0x7fb33406ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.424 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7fb33aa91640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb334142830 0x7fb334071060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.424 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7fb33aa91640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb334142c10 0x7fb3340715a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.424 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7fb33aa91640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb3341422b0 con 0x7fb334142c10 2024-06-11T17:18:22.424 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7fb33aa91640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb334142130 con 0x7fb334142830 2024-06-11T17:18:22.425 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7fb33aa91640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fb33414c060 con 0x7fb3340b0950 2024-06-11T17:18:22.425 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7fb33a290640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb334142c10 0x7fb3340715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.425 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7fb33a290640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb334142c10 0x7fb3340715a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38524/0 (socket says 172.21.15.130:38524) 2024-06-11T17:18:22.425 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7fb33a290640 1 -- 172.21.15.130:0/347719826 learned_addr learned my addr 172.21.15.130:0/347719826 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:22.425 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7f786024e640 1 -- 172.21.15.130:0/2031324869 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78581464c0 con 0x7f78580abe30 2024-06-11T17:18:22.425 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7fb33928e640 1 --2- 172.21.15.130:0/347719826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb334142830 0x7fb334071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.426 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7fb33a290640 1 -- 172.21.15.130:0/347719826 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb3340b0950 msgr2=0x7fb33406ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.426 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7fb33a290640 1 --2- 172.21.15.130:0/347719826 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb3340b0950 0x7fb33406ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.426 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7fb33a290640 1 -- 172.21.15.130:0/347719826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb334142830 msgr2=0x7fb334071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.426 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7fb33a290640 1 --2- 172.21.15.130:0/347719826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb334142830 0x7fb334071060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.426 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7fb33a290640 1 -- 172.21.15.130:0/347719826 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb33406f240 con 0x7fb334142c10 2024-06-11T17:18:22.427 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7f0465bfd640 1 -- 172.21.15.130:0/3516177794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04580cb240 msgr2=0x7f04580c4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.427 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7f0465bfd640 1 --2- 172.21.15.130:0/3516177794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04580cb240 0x7f04580c4da0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f044c009870 tx=0x7f044c01c540 comp rx=0 tx=0).stop 2024-06-11T17:18:22.427 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7f0465bfd640 1 -- 172.21.15.130:0/3516177794 shutdown_connections 2024-06-11T17:18:22.427 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7f0465bfd640 1 --2- 172.21.15.130:0/3516177794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04580cb240 0x7f04580c4da0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.427 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7f0465bfd640 1 --2- 172.21.15.130:0/3516177794 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0458039210 0x7f0458035770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.427 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7f0465bfd640 1 -- 172.21.15.130:0/3516177794 >> 172.21.15.130:0/3516177794 conn(0x7f0458006c10 msgr2=0x7f0458037890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:22.427 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.406+0000 7fb33a290640 1 --2- 172.21.15.130:0/347719826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb334142c10 0x7fb3340715a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb33001f250 tx=0x7fb33001b750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.428 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.410+0000 7f0465bfd640 1 -- 172.21.15.130:0/3516177794 shutdown_connections 2024-06-11T17:18:22.428 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.410+0000 7f41ebfff640 1 -- 172.21.15.130:0/4234652189 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f41ec01a070 con 0x7f41f80cedc0 2024-06-11T17:18:22.428 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.410+0000 7f41ebfff640 1 --2- 172.21.15.130:0/4234652189 >> v2:172.21.15.130:6816/3863300924 conn(0x7f41e4070e30 0x7f41e40732f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.428 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.410+0000 7f41ebfff640 1 -- 172.21.15.130:0/4234652189 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4090+0+0 (secure 0 0 0) 0x7f41ec08ff30 con 0x7f41f80cedc0 2024-06-11T17:18:22.428 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.410+0000 7f41ff7fe640 1 --2- 172.21.15.130:0/4234652189 >> v2:172.21.15.130:6816/3863300924 conn(0x7f41e4070e30 0x7f41e40732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.428 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.410+0000 7f41ff7fe640 1 --2- 172.21.15.130:0/4234652189 >> v2:172.21.15.130:6816/3863300924 conn(0x7f41e4070e30 0x7f41e40732f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f41f4009630 tx=0x7f41f40a6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.429 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.410+0000 7f4aaa72c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4a9c02a1a0 0x7f4a9c0c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.429 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.410+0000 7f4aaa72c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a9c0c91a0 0x7f4a9c0ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.429 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.410+0000 7f4aaa72c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9c0d8d10 con 0x7f4a9c0c91a0 2024-06-11T17:18:22.429 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.410+0000 7f4aaa72c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9c0d8b90 con 0x7f4a9c007c70 2024-06-11T17:18:22.429 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.410+0000 7f4aaa72c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4a9c0d8e90 con 0x7f4a9c02a1a0 2024-06-11T17:18:22.429 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.410+0000 7f4aa8f29640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4a9c02a1a0 0x7f4a9c0c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.429 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.410+0000 7f4aa8f29640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4a9c02a1a0 0x7f4a9c0c9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:53674/0 (socket says 172.21.15.130:53674) 2024-06-11T17:18:22.429 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.410+0000 7f4aa8f29640 1 -- 172.21.15.130:0/2133431661 learned_addr learned my addr 172.21.15.130:0/2133431661 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:22.430 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.410+0000 7fdb267fc640 1 -- 172.21.15.130:0/2590027127 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7fdb200bc020 con 0x7fdb300ac530 2024-06-11T17:18:22.430 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.410+0000 7fdb267fc640 1 --2- 172.21.15.130:0/2590027127 >> v2:172.21.15.130:6816/3863300924 conn(0x7fdb14070d90 0x7fdb14073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.430 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.410+0000 7fdb267fc640 1 -- 172.21.15.130:0/2590027127 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4090+0+0 (secure 0 0 0) 0x7fdb2012b210 con 0x7fdb300ac530 2024-06-11T17:18:22.430 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.410+0000 7fdb35078640 1 --2- 172.21.15.130:0/2590027127 >> v2:172.21.15.130:6816/3863300924 conn(0x7fdb14070d90 0x7fdb14073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.430 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.410+0000 7fdb35078640 1 --2- 172.21.15.130:0/2590027127 >> v2:172.21.15.130:6816/3863300924 conn(0x7fdb14070d90 0x7fdb14073250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdb3013efd0 tx=0x7fdb2c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.430 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.410+0000 7f0465bfd640 1 -- 172.21.15.130:0/3516177794 wait complete. 2024-06-11T17:18:22.430 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.410+0000 7f0465bfd640 1 Processor -- start 2024-06-11T17:18:22.431 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.410+0000 7f4aa8f29640 1 -- 172.21.15.130:0/2133431661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a9c007c70 msgr2=0x7f4a9c0c9650 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-11T17:18:22.431 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.410+0000 7f4aa8f29640 1 --2- 172.21.15.130:0/2133431661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a9c007c70 0x7f4a9c0c9650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.431 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.410+0000 7f4aa8f29640 1 -- 172.21.15.130:0/2133431661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a9c0c91a0 msgr2=0x7f4a9c0ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.431 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.410+0000 7f4aa8f29640 1 --2- 172.21.15.130:0/2133431661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a9c0c91a0 0x7f4a9c0ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.431 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.410+0000 7f4aa8f29640 1 -- 172.21.15.130:0/2133431661 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a9c037f80 con 0x7f4a9c02a1a0 2024-06-11T17:18:22.431 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.410+0000 7f4aa8f29640 1 --2- 172.21.15.130:0/2133431661 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4a9c02a1a0 0x7f4a9c0c9b90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4aa000c7f0 tx=0x7f4aa000ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.432 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.410+0000 7f0465bfd640 1 -- start start 2024-06-11T17:18:22.432 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.410+0000 7f0465bfd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0458039210 0x7f045803be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.432 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.410+0000 7f0465bfd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04580c49a0 0x7f0458033310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.432 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.410+0000 7f0465bfd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04580cb240 0x7f0458033850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.433 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.410+0000 7f0465bfd640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f04580d4a30 con 0x7f04580cb240 2024-06-11T17:18:22.433 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.410+0000 7f0465bfd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f04580d48b0 con 0x7f04580c49a0 2024-06-11T17:18:22.433 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.410+0000 7f0465bfd640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f04580d4bb0 con 0x7f0458039210 2024-06-11T17:18:22.433 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.414+0000 7f0464bfb640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0458039210 0x7f045803be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.433 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.414+0000 7f045ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04580c49a0 0x7f0458033310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.433 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.414+0000 7f0464bfb640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0458039210 0x7f045803be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:53680/0 (socket says 172.21.15.130:53680) 2024-06-11T17:18:22.433 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.414+0000 7f0464bfb640 1 -- 172.21.15.130:0/3648479871 learned_addr learned my addr 172.21.15.130:0/3648479871 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:22.433 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.414+0000 7f04653fc640 1 --2- 172.21.15.130:0/3648479871 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04580cb240 0x7f0458033850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.433 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.414+0000 7f0464bfb640 1 -- 172.21.15.130:0/3648479871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04580c49a0 msgr2=0x7f0458033310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.433 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.414+0000 7f0464bfb640 1 --2- 172.21.15.130:0/3648479871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04580c49a0 0x7f0458033310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.433 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.414+0000 7f0464bfb640 1 -- 172.21.15.130:0/3648479871 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04580cb240 msgr2=0x7f0458033850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.433 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.414+0000 7f0464bfb640 1 --2- 172.21.15.130:0/3648479871 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04580cb240 0x7f0458033850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.433 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.414+0000 7f0464bfb640 1 -- 172.21.15.130:0/3648479871 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0458031920 con 0x7f0458039210 2024-06-11T17:18:22.433 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.414+0000 7f045ffff640 1 --2- 172.21.15.130:0/3648479871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04580c49a0 0x7f0458033310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-11T17:18:22.433 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.414+0000 7f0464bfb640 1 --2- 172.21.15.130:0/3648479871 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0458039210 0x7f045803be90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0460051170 tx=0x7f0460074730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.434 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.414+0000 7fdb267fc640 1 -- 172.21.15.130:0/2590027127 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7fdb300713c0 con 0x7fdb300ac530 2024-06-11T17:18:22.434 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.414+0000 7f4a99ffb640 1 -- 172.21.15.130:0/2133431661 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa0007a30 con 0x7f4a9c02a1a0 2024-06-11T17:18:22.434 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.414+0000 7f4a99ffb640 1 -- 172.21.15.130:0/2133431661 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aa0007bd0 con 0x7f4a9c02a1a0 2024-06-11T17:18:22.434 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.414+0000 7f4a99ffb640 1 -- 172.21.15.130:0/2133431661 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa00113f0 con 0x7f4a9c02a1a0 2024-06-11T17:18:22.435 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.414+0000 7fb32a7fc640 1 -- 172.21.15.130:0/347719826 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3300bd070 con 0x7fb334142c10 2024-06-11T17:18:22.435 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.414+0000 7fb33aa91640 1 -- 172.21.15.130:0/347719826 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb334070210 con 0x7fb334142c10 2024-06-11T17:18:22.435 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.414+0000 7fb33aa91640 1 -- 172.21.15.130:0/347719826 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3340707d0 con 0x7fb334142c10 2024-06-11T17:18:22.435 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.414+0000 7f784e7fc640 1 -- 172.21.15.130:0/2031324869 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7f784805bf90 con 0x7f78580abe30 2024-06-11T17:18:22.435 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.414+0000 7f4aaa72c640 1 -- 172.21.15.130:0/2133431661 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a9c0c75b0 con 0x7f4a9c02a1a0 2024-06-11T17:18:22.436 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.414+0000 7f4aaa72c640 1 -- 172.21.15.130:0/2133431661 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a9c0c66f0 con 0x7f4a9c02a1a0 2024-06-11T17:18:22.436 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.414+0000 7f4aaa72c640 1 -- 172.21.15.130:0/2133431661 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a84005090 con 0x7f4a9c02a1a0 2024-06-11T17:18:22.436 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.414+0000 7f045d7fa640 1 -- 172.21.15.130:0/3648479871 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0460068fc0 con 0x7f0458039210 2024-06-11T17:18:22.436 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.414+0000 7f045d7fa640 1 -- 172.21.15.130:0/3648479871 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0460069160 con 0x7f0458039210 2024-06-11T17:18:22.436 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.414+0000 7f045d7fa640 1 -- 172.21.15.130:0/3648479871 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046006aed0 con 0x7f0458039210 2024-06-11T17:18:22.436 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.414+0000 7fb32a7fc640 1 -- 172.21.15.130:0/347719826 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb330000e50 con 0x7fb334142c10 2024-06-11T17:18:22.437 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.414+0000 7fb33aa91640 1 -- 172.21.15.130:0/347719826 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb31c005090 con 0x7fb334142c10 2024-06-11T17:18:22.437 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.414+0000 7fb32a7fc640 1 -- 172.21.15.130:0/347719826 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3300c6060 con 0x7fb334142c10 2024-06-11T17:18:22.437 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.414+0000 7f0465bfd640 1 -- 172.21.15.130:0/3648479871 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0458032ba0 con 0x7f0458039210 2024-06-11T17:18:22.437 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.414+0000 7f0465bfd640 1 -- 172.21.15.130:0/3648479871 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f045803c3d0 con 0x7f0458039210 2024-06-11T17:18:22.437 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.418+0000 7f0465bfd640 1 -- 172.21.15.130:0/3648479871 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0458035770 con 0x7f0458039210 2024-06-11T17:18:22.437 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.418+0000 7fb32a7fc640 1 -- 172.21.15.130:0/347719826 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7fb3300af640 con 0x7fb334142c10 2024-06-11T17:18:22.438 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.418+0000 7fb32a7fc640 1 --2- 172.21.15.130:0/347719826 >> v2:172.21.15.130:6816/3863300924 conn(0x7fb318070d60 0x7fb318073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.438 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.418+0000 7f4a99ffb640 1 -- 172.21.15.130:0/2133431661 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f4aa0011590 con 0x7f4a9c02a1a0 2024-06-11T17:18:22.438 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.418+0000 7f4a99ffb640 1 --2- 172.21.15.130:0/2133431661 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4a88070db0 0x7f4a88073270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.438 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.418+0000 7f4aa972a640 1 --2- 172.21.15.130:0/2133431661 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4a88070db0 0x7f4a88073270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.438 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.418+0000 7f4aa972a640 1 --2- 172.21.15.130:0/2133431661 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4a88070db0 0x7f4a88073270 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4a940ad000 tx=0x7f4a940a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.438 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.418+0000 7fb339a8f640 1 --2- 172.21.15.130:0/347719826 >> v2:172.21.15.130:6816/3863300924 conn(0x7fb318070d60 0x7fb318073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.439 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.418+0000 7f4a99ffb640 1 -- 172.21.15.130:0/2133431661 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 4090+0+0 (secure 0 0 0) 0x7f4aa0059880 con 0x7f4a9c02a1a0 2024-06-11T17:18:22.439 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.422+0000 7fb339a8f640 1 --2- 172.21.15.130:0/347719826 >> v2:172.21.15.130:6816/3863300924 conn(0x7fb318070d60 0x7fb318073220 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb324006aa0 tx=0x7fb324006a30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.439 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.422+0000 7fb32a7fc640 1 -- 172.21.15.130:0/347719826 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4090+0+0 (secure 0 0 0) 0x7fb3300f32c0 con 0x7fb334142c10 2024-06-11T17:18:22.440 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.422+0000 7f41ebfff640 1 -- 172.21.15.130:0/4234652189 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7f41f802cdc0 con 0x7f41f80cedc0 2024-06-11T17:18:22.440 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.422+0000 7f045d7fa640 1 -- 172.21.15.130:0/3648479871 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f046006b070 con 0x7f0458039210 2024-06-11T17:18:22.440 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.422+0000 7f045d7fa640 1 --2- 172.21.15.130:0/3648479871 >> v2:172.21.15.130:6816/3863300924 conn(0x7f0444070db0 0x7f0444073270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.440 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.422+0000 7f045ffff640 1 --2- 172.21.15.130:0/3648479871 >> v2:172.21.15.130:6816/3863300924 conn(0x7f0444070db0 0x7f0444073270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.440 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.426+0000 7f045ffff640 1 --2- 172.21.15.130:0/3648479871 >> v2:172.21.15.130:6816/3863300924 conn(0x7f0444070db0 0x7f0444073270 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f045800dcb0 tx=0x7f0454008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.441 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.422+0000 7f9b24eb4640 1 Processor -- start 2024-06-11T17:18:22.441 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.422+0000 7f9b24eb4640 1 -- start start 2024-06-11T17:18:22.441 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.426+0000 7f9b24eb4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9b200ac290 0x7f9b200af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.442 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.426+0000 7f9b24eb4640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9b2006c050 0x7f9b2006c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.442 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.426+0000 7f9b24eb4640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b200abb80 con 0x7f9b20144390 2024-06-11T17:18:22.442 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.426+0000 7f9b24eb4640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f9b200ac670 con 0x7f9b200ac290 2024-06-11T17:18:22.442 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.426+0000 7f9b24eb4640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9b2006c9d0 con 0x7f9b2006c050 2024-06-11T17:18:22.442 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.426+0000 7f9b1ed9d640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f9b20144390 0x7f9b20144840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:35418/0 (socket says 172.21.15.130:35418) 2024-06-11T17:18:22.442 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.426+0000 7f9b1ed9d640 1 -- 172.21.15.130:0/1033483242 learned_addr learned my addr 172.21.15.130:0/1033483242 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-06-11T17:18:22.442 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.426+0000 7f9b1dd9b640 1 --2- 172.21.15.130:0/1033483242 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9b2006c050 0x7f9b2006c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.442 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.426+0000 7f9b1e59c640 1 --2- 172.21.15.130:0/1033483242 >> v2:172.21.15.130:3300/0 conn(0x7f9b200ac290 0x7f9b200af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.442 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.426+0000 7f9b1dd9b640 1 -- 172.21.15.130:0/1033483242 >> v2:172.21.15.130:3300/0 conn(0x7f9b200ac290 msgr2=0x7f9b200af1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:22.442 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.426+0000 7f9b1dd9b640 1 --2- 172.21.15.130:0/1033483242 >> v2:172.21.15.130:3300/0 conn(0x7f9b200ac290 0x7f9b200af1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.442 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.426+0000 7f9b1dd9b640 1 -- 172.21.15.130:0/1033483242 >> v1:172.21.15.130:6789/0 conn(0x7f9b20144390 legacy=0x7f9b20144840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.442 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.426+0000 7f9b1dd9b640 1 -- 172.21.15.130:0/1033483242 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b200aa520 con 0x7f9b2006c050 2024-06-11T17:18:22.442 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.430+0000 7f9b1dd9b640 1 --2- 172.21.15.130:0/1033483242 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9b2006c050 0x7f9b2006c490 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9b100097f0 tx=0x7f9b1001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf0168a50ef81385 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.443 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.430+0000 7f4a99ffb640 1 -- 172.21.15.130:0/2133431661 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7f4aa0015020 con 0x7f4a9c02a1a0 2024-06-11T17:18:22.443 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.430+0000 7f045d7fa640 1 -- 172.21.15.130:0/3648479871 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 4090+0+0 (secure 0 0 0) 0x7f04600d5320 con 0x7f0458039210 2024-06-11T17:18:22.443 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.430+0000 7f9b1d59a640 1 -- 172.21.15.130:0/1033483242 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b100ab650 con 0x7f9b2006c050 2024-06-11T17:18:22.443 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.430+0000 7fb32a7fc640 1 -- 172.21.15.130:0/347719826 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7fb33406f240 con 0x7fb334142c10 2024-06-11T17:18:22.444 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.438+0000 7f045d7fa640 1 -- 172.21.15.130:0/3648479871 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7f046009b030 con 0x7f0458039210 2024-06-11T17:18:22.444 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.442+0000 7f9b1d59a640 1 -- 172.21.15.130:0/1033483242 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b100b0070 con 0x7f9b2006c050 2024-06-11T17:18:22.444 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.442+0000 7f9b24eb4640 1 -- 172.21.15.130:0/1033483242 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9b2006c050 msgr2=0x7f9b2006c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.445 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.442+0000 7f9b24eb4640 1 --2- 172.21.15.130:0/1033483242 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9b2006c050 0x7f9b2006c490 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9b100097f0 tx=0x7f9b1001c450 comp rx=0 tx=0).stop 2024-06-11T17:18:22.445 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.446+0000 7f9b24eb4640 1 -- 172.21.15.130:0/1033483242 shutdown_connections 2024-06-11T17:18:22.445 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.446+0000 7f9b24eb4640 1 --2- 172.21.15.130:0/1033483242 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9b2006c050 0x7f9b2006c490 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.445 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.446+0000 7f9b24eb4640 1 --2- 172.21.15.130:0/1033483242 >> v2:172.21.15.130:3300/0 conn(0x7f9b200ac290 0x7f9b200af1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.445 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.446+0000 7f9b24eb4640 1 -- 172.21.15.130:0/1033483242 >> 172.21.15.130:0/1033483242 conn(0x7f9b2006d160 msgr2=0x7f9b2006d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:22.445 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.446+0000 7f9b24eb4640 1 -- 172.21.15.130:0/1033483242 shutdown_connections 2024-06-11T17:18:22.445 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.446+0000 7f9b24eb4640 1 -- 172.21.15.130:0/1033483242 wait complete. 2024-06-11T17:18:22.445 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.446+0000 7f9b24eb4640 1 Processor -- start 2024-06-11T17:18:22.446 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.446+0000 7f9b24eb4640 1 -- start start 2024-06-11T17:18:22.446 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.446+0000 7f9b24eb4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b2006c050 0x7f9b2014a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.446 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.446+0000 7f9b24eb4640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9b200ac290 0x7f9b201dee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.446 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.446+0000 7f9b24eb4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b20144390 0x7f9b2006fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.446 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.446+0000 7f9b24eb4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9b20154340 con 0x7f9b20144390 2024-06-11T17:18:22.447 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.446+0000 7f9b24eb4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9b201541c0 con 0x7f9b2006c050 2024-06-11T17:18:22.447 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.446+0000 7f9b24eb4640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9b201544c0 con 0x7f9b200ac290 2024-06-11T17:18:22.447 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.446+0000 7f9b1e59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b2006c050 0x7f9b2014a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.447 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.446+0000 7f9b1e59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b2006c050 0x7f9b2014a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.130:57372/0 (socket says 172.21.15.130:57372) 2024-06-11T17:18:22.447 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.446+0000 7f9b1e59c640 1 -- 172.21.15.130:0/3218056384 learned_addr learned my addr 172.21.15.130:0/3218056384 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:22.447 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.446+0000 7f9b1ed9d640 1 --2- 172.21.15.130:0/3218056384 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b20144390 0x7f9b2006fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.447 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.450+0000 7f9b1dd9b640 1 --2- 172.21.15.130:0/3218056384 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9b200ac290 0x7f9b201dee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.448 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.450+0000 7f9b1ed9d640 1 -- 172.21.15.130:0/3218056384 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9b200ac290 msgr2=0x7f9b201dee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.448 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.450+0000 7f9b1ed9d640 1 --2- 172.21.15.130:0/3218056384 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9b200ac290 0x7f9b201dee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.448 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.450+0000 7f9b1ed9d640 1 -- 172.21.15.130:0/3218056384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b2006c050 msgr2=0x7f9b2014a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.448 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.450+0000 7f9b1ed9d640 1 --2- 172.21.15.130:0/3218056384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b2006c050 0x7f9b2014a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.448 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.450+0000 7f9b1ed9d640 1 -- 172.21.15.130:0/3218056384 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b200738f0 con 0x7f9b20144390 2024-06-11T17:18:22.448 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.450+0000 7f9b1ed9d640 1 --2- 172.21.15.130:0/3218056384 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b20144390 0x7f9b2006fd10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9b1800caa0 tx=0x7f9b1800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.449 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.450+0000 7f9b0effd640 1 -- 172.21.15.130:0/3218056384 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b18017070 con 0x7f9b20144390 2024-06-11T17:18:22.450 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.450+0000 7f9b24eb4640 1 -- 172.21.15.130:0/3218056384 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b201df610 con 0x7f9b20144390 2024-06-11T17:18:22.450 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.450+0000 7f9b24eb4640 1 -- 172.21.15.130:0/3218056384 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b201dfca0 con 0x7f9b20144390 2024-06-11T17:18:22.452 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.454+0000 7f9b0effd640 1 -- 172.21.15.130:0/3218056384 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b1800ab60 con 0x7f9b20144390 2024-06-11T17:18:22.453 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.454+0000 7f9b0effd640 1 -- 172.21.15.130:0/3218056384 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b18012400 con 0x7f9b20144390 2024-06-11T17:18:22.454 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.454+0000 7f9b0effd640 1 -- 172.21.15.130:0/3218056384 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f9b1801a070 con 0x7f9b20144390 2024-06-11T17:18:22.454 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.454+0000 7f9b0effd640 1 --2- 172.21.15.130:0/3218056384 >> v2:172.21.15.130:6816/3863300924 conn(0x7f9b00070e60 0x7f9b00073320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:22.455 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.458+0000 7f9b1e59c640 1 --2- 172.21.15.130:0/3218056384 >> v2:172.21.15.130:6816/3863300924 conn(0x7f9b00070e60 0x7f9b00073320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:22.455 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.458+0000 7f9b0effd640 1 -- 172.21.15.130:0/3218056384 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4090+0+0 (secure 0 0 0) 0x7f9b18090630 con 0x7f9b20144390 2024-06-11T17:18:22.455 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.458+0000 7f9b1e59c640 1 --2- 172.21.15.130:0/3218056384 >> v2:172.21.15.130:6816/3863300924 conn(0x7f9b00070e60 0x7f9b00073320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9b14009ba0 tx=0x7f9b14009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:22.462 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.462+0000 7f9b24eb4640 1 -- 172.21.15.130:0/3218056384 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b04005090 con 0x7f9b20144390 2024-06-11T17:18:22.471 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.474+0000 7f9b0effd640 1 -- 172.21.15.130:0/3218056384 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7f9b201df610 con 0x7f9b20144390 2024-06-11T17:18:22.710 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.710+0000 7f050f7a1640 1 -- 172.21.15.130:0/1231855691 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f0508145c40 con 0x7f05080ac530 2024-06-11T17:18:22.710 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.710+0000 7f04fdffb640 1 -- 172.21.15.130:0/1231855691 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f050405cd70 con 0x7f05080ac530 2024-06-11T17:18:22.711 INFO:teuthology.orchestra.run.smithi130.stdout:60129542146 2024-06-11T17:18:22.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.714+0000 7f04f37fe640 1 -- 172.21.15.130:0/1231855691 >> v2:172.21.15.130:6816/3863300924 conn(0x7f04ec070e90 msgr2=0x7f04ec073350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.714+0000 7f04f37fe640 1 --2- 172.21.15.130:0/1231855691 >> v2:172.21.15.130:6816/3863300924 conn(0x7f04ec070e90 0x7f04ec073350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f05000b2000 tx=0x7f05000a9070 comp rx=0 tx=0).stop 2024-06-11T17:18:22.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.714+0000 7f04f37fe640 1 -- 172.21.15.130:0/1231855691 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05080ac530 msgr2=0x7f050813f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.714+0000 7f04f37fe640 1 --2- 172.21.15.130:0/1231855691 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05080ac530 0x7f050813f340 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f050400e960 tx=0x7f050400ee20 comp rx=0 tx=0).stop 2024-06-11T17:18:22.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.714+0000 7f04f37fe640 1 -- 172.21.15.130:0/1231855691 shutdown_connections 2024-06-11T17:18:22.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.718+0000 7f04f37fe640 1 --2- 172.21.15.130:0/1231855691 >> v2:172.21.15.130:6816/3863300924 conn(0x7f04ec070e90 0x7f04ec073350 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.718+0000 7f04f37fe640 1 --2- 172.21.15.130:0/1231855691 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05081e2c10 0x7f05081460d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.718+0000 7f04f37fe640 1 --2- 172.21.15.130:0/1231855691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05080adfa0 0x7f0508147d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.718+0000 7f04f37fe640 1 --2- 172.21.15.130:0/1231855691 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05080ac530 0x7f050813f340 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.718+0000 7f04f37fe640 1 -- 172.21.15.130:0/1231855691 >> 172.21.15.130:0/1231855691 conn(0x7f05080b4ab0 msgr2=0x7f05080b4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:22.716 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.718+0000 7f04f37fe640 1 -- 172.21.15.130:0/1231855691 shutdown_connections 2024-06-11T17:18:22.716 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.718+0000 7f04f37fe640 1 -- 172.21.15.130:0/1231855691 wait complete. 2024-06-11T17:18:22.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.4 2024-06-11T17:18:22.738 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.738+0000 7f4204c0e640 1 -- 172.21.15.130:0/4234652189 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f41e0005650 con 0x7f41f80cedc0 2024-06-11T17:18:22.739 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.742+0000 7f41ebfff640 1 -- 172.21.15.130:0/4234652189 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f41ec005480 con 0x7f41f80cedc0 2024-06-11T17:18:22.741 INFO:teuthology.orchestra.run.smithi130.stdout:60129542146 2024-06-11T17:18:22.743 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.742+0000 7f4204c0e640 1 -- 172.21.15.130:0/4234652189 >> v2:172.21.15.130:6816/3863300924 conn(0x7f41e4070e30 msgr2=0x7f41e40732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.743 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.742+0000 7f4204c0e640 1 --2- 172.21.15.130:0/4234652189 >> v2:172.21.15.130:6816/3863300924 conn(0x7f41e4070e30 0x7f41e40732f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f41f4009630 tx=0x7f41f40a6040 comp rx=0 tx=0).stop 2024-06-11T17:18:22.743 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.742+0000 7f4204c0e640 1 -- 172.21.15.130:0/4234652189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41f80cedc0 msgr2=0x7f41f80d3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.743 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.742+0000 7f4204c0e640 1 --2- 172.21.15.130:0/4234652189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41f80cedc0 0x7f41f80d3e20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f41ec00c3c0 tx=0x7f41ec00c7c0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.743 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.742+0000 7f4204c0e640 1 -- 172.21.15.130:0/4234652189 shutdown_connections 2024-06-11T17:18:22.744 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.742+0000 7f4204c0e640 1 --2- 172.21.15.130:0/4234652189 >> v2:172.21.15.130:6816/3863300924 conn(0x7f41e4070e30 0x7f41e40732f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.744 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.746+0000 7f4204c0e640 1 --2- 172.21.15.130:0/4234652189 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f41f80d3470 0x7f41f80d4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.744 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.746+0000 7f4204c0e640 1 --2- 172.21.15.130:0/4234652189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41f80cedc0 0x7f41f80d3e20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.744 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.746+0000 7f4204c0e640 1 --2- 172.21.15.130:0/4234652189 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41f80c8840 0x7f41f8167940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.744 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.746+0000 7f4204c0e640 1 -- 172.21.15.130:0/4234652189 >> 172.21.15.130:0/4234652189 conn(0x7f41f8005a10 msgr2=0x7f41f80d5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:22.744 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.746+0000 7f4204c0e640 1 -- 172.21.15.130:0/4234652189 shutdown_connections 2024-06-11T17:18:22.744 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.746+0000 7f4204c0e640 1 -- 172.21.15.130:0/4234652189 wait complete. 2024-06-11T17:18:22.745 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.746+0000 7fdb37add640 1 -- 172.21.15.130:0/2590027127 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fdb30076380 con 0x7fdb300ac530 2024-06-11T17:18:22.746 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.746+0000 7f786024e640 1 -- 172.21.15.130:0/2031324869 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f78580b29c0 con 0x7f78580abe30 2024-06-11T17:18:22.746 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.746+0000 7fdb267fc640 1 -- 172.21.15.130:0/2590027127 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdb20016170 con 0x7fdb300ac530 2024-06-11T17:18:22.747 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.746+0000 7f784e7fc640 1 -- 172.21.15.130:0/2031324869 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7848060290 con 0x7f78580abe30 2024-06-11T17:18:22.747 INFO:teuthology.orchestra.run.smithi130.stdout:60129542147 2024-06-11T17:18:22.748 INFO:teuthology.orchestra.run.smithi130.stdout:55834574849 2024-06-11T17:18:22.750 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.750+0000 7fdb37add640 1 -- 172.21.15.130:0/2590027127 >> v2:172.21.15.130:6816/3863300924 conn(0x7fdb14070d90 msgr2=0x7fdb14073250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.750 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.750+0000 7fdb37add640 1 --2- 172.21.15.130:0/2590027127 >> v2:172.21.15.130:6816/3863300924 conn(0x7fdb14070d90 0x7fdb14073250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdb3013efd0 tx=0x7fdb2c008040 comp rx=0 tx=0).stop 2024-06-11T17:18:22.750 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.750+0000 7fdb37add640 1 -- 172.21.15.130:0/2590027127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb300ac530 msgr2=0x7fdb3006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.750 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.750+0000 7fdb37add640 1 --2- 172.21.15.130:0/2590027127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb300ac530 0x7fdb3006f040 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdb2001a0f0 tx=0x7fdb20019260 comp rx=0 tx=0).stop 2024-06-11T17:18:22.750 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.750+0000 7fdb37add640 1 -- 172.21.15.130:0/2590027127 shutdown_connections 2024-06-11T17:18:22.750 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.750+0000 7fdb37add640 1 --2- 172.21.15.130:0/2590027127 >> v2:172.21.15.130:6816/3863300924 conn(0x7fdb14070d90 0x7fdb14073250 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.750 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.750+0000 7fdb37add640 1 --2- 172.21.15.130:0/2590027127 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdb3013d500 0x7fdb3013d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.750 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.750+0000 7fdb37add640 1 --2- 172.21.15.130:0/2590027127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb300af0b0 0x7fdb3006f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.750 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.750+0000 7fdb37add640 1 --2- 172.21.15.130:0/2590027127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb300ac530 0x7fdb3006f040 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.751 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.750+0000 7fdb37add640 1 -- 172.21.15.130:0/2590027127 >> 172.21.15.130:0/2590027127 conn(0x7fdb300b4ab0 msgr2=0x7fdb300b3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:22.751 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.750+0000 7fdb37add640 1 -- 172.21.15.130:0/2590027127 shutdown_connections 2024-06-11T17:18:22.751 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.750+0000 7fdb37add640 1 -- 172.21.15.130:0/2590027127 wait complete. 2024-06-11T17:18:22.751 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.750+0000 7f786024e640 1 -- 172.21.15.130:0/2031324869 >> v2:172.21.15.130:6816/3863300924 conn(0x7f783c070d90 msgr2=0x7f783c073250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.751 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.750+0000 7f786024e640 1 --2- 172.21.15.130:0/2031324869 >> v2:172.21.15.130:6816/3863300924 conn(0x7f783c070d90 0x7f783c073250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7854007fd0 tx=0x7f7854007240 comp rx=0 tx=0).stop 2024-06-11T17:18:22.751 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.750+0000 7f786024e640 1 -- 172.21.15.130:0/2031324869 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78580abe30 msgr2=0x7f785814ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.751 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.750+0000 7f786024e640 1 --2- 172.21.15.130:0/2031324869 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78580abe30 0x7f785814ae40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f784800c420 tx=0x7f784800c8e0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.751 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.754+0000 7f786024e640 1 -- 172.21.15.130:0/2031324869 shutdown_connections 2024-06-11T17:18:22.752 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.754+0000 7f786024e640 1 --2- 172.21.15.130:0/2031324869 >> v2:172.21.15.130:6816/3863300924 conn(0x7f783c070d90 0x7f783c073250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.752 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.754+0000 7f786024e640 1 --2- 172.21.15.130:0/2031324869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78580ac210 0x7f78581eae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.752 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.754+0000 7f786024e640 1 --2- 172.21.15.130:0/2031324869 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78580abe30 0x7f785814ae40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.752 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.754+0000 7f786024e640 1 --2- 172.21.15.130:0/2031324869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78580aadf0 0x7f78581dde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.752 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.754+0000 7f786024e640 1 -- 172.21.15.130:0/2031324869 >> 172.21.15.130:0/2031324869 conn(0x7f78580b4ab0 msgr2=0x7f78580afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:22.752 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.754+0000 7f786024e640 1 -- 172.21.15.130:0/2031324869 shutdown_connections 2024-06-11T17:18:22.752 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.754+0000 7f786024e640 1 -- 172.21.15.130:0/2031324869 wait complete. 2024-06-11T17:18:22.755 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.758+0000 7f4aaa72c640 1 -- 172.21.15.130:0/2133431661 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f4a84005650 con 0x7f4a9c02a1a0 2024-06-11T17:18:22.756 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.758+0000 7f4a99ffb640 1 -- 172.21.15.130:0/2133431661 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4aa005d990 con 0x7f4a9c02a1a0 2024-06-11T17:18:22.756 INFO:teuthology.orchestra.run.smithi130.stdout:60129542147 2024-06-11T17:18:22.758 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.758+0000 7fb33aa91640 1 -- 172.21.15.130:0/347719826 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb31c005650 con 0x7fb334142c10 2024-06-11T17:18:22.759 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.758+0000 7f4aaa72c640 1 -- 172.21.15.130:0/2133431661 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4a88070db0 msgr2=0x7f4a88073270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.759 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.758+0000 7f4aaa72c640 1 --2- 172.21.15.130:0/2133431661 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4a88070db0 0x7f4a88073270 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4a940ad000 tx=0x7f4a940a6000 comp rx=0 tx=0).stop 2024-06-11T17:18:22.759 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.758+0000 7f4aaa72c640 1 -- 172.21.15.130:0/2133431661 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4a9c02a1a0 msgr2=0x7f4a9c0c9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.759 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.758+0000 7f4aaa72c640 1 --2- 172.21.15.130:0/2133431661 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4a9c02a1a0 0x7f4a9c0c9b90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4aa000c7f0 tx=0x7f4aa000ccb0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.759 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.762+0000 7f4aaa72c640 1 -- 172.21.15.130:0/2133431661 shutdown_connections 2024-06-11T17:18:22.759 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.762+0000 7f4aaa72c640 1 --2- 172.21.15.130:0/2133431661 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4a88070db0 0x7f4a88073270 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.759 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.762+0000 7f4aaa72c640 1 --2- 172.21.15.130:0/2133431661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a9c0c91a0 0x7f4a9c0ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.759 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.762+0000 7f4aaa72c640 1 --2- 172.21.15.130:0/2133431661 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4a9c02a1a0 0x7f4a9c0c9b90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.759 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.762+0000 7f4aaa72c640 1 --2- 172.21.15.130:0/2133431661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a9c007c70 0x7f4a9c0c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.759 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.762+0000 7f4aaa72c640 1 -- 172.21.15.130:0/2133431661 >> 172.21.15.130:0/2133431661 conn(0x7f4a9c006b20 msgr2=0x7f4a9c0c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:22.759 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.762+0000 7fb32a7fc640 1 -- 172.21.15.130:0/347719826 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb3300186c0 con 0x7fb334142c10 2024-06-11T17:18:22.760 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.762+0000 7f4aaa72c640 1 -- 172.21.15.130:0/2133431661 shutdown_connections 2024-06-11T17:18:22.760 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.762+0000 7f4aaa72c640 1 -- 172.21.15.130:0/2133431661 wait complete. 2024-06-11T17:18:22.760 INFO:teuthology.orchestra.run.smithi130.stdout:55834574851 2024-06-11T17:18:22.763 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.762+0000 7fb33aa91640 1 -- 172.21.15.130:0/347719826 >> v2:172.21.15.130:6816/3863300924 conn(0x7fb318070d60 msgr2=0x7fb318073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.763 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.762+0000 7fb33aa91640 1 --2- 172.21.15.130:0/347719826 >> v2:172.21.15.130:6816/3863300924 conn(0x7fb318070d60 0x7fb318073220 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb324006aa0 tx=0x7fb324006a30 comp rx=0 tx=0).stop 2024-06-11T17:18:22.763 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.762+0000 7fb33aa91640 1 -- 172.21.15.130:0/347719826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb334142c10 msgr2=0x7fb3340715a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.763 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.762+0000 7fb33aa91640 1 --2- 172.21.15.130:0/347719826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb334142c10 0x7fb3340715a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb33001f250 tx=0x7fb33001b750 comp rx=0 tx=0).stop 2024-06-11T17:18:22.763 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.762+0000 7fb33aa91640 1 -- 172.21.15.130:0/347719826 shutdown_connections 2024-06-11T17:18:22.763 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.762+0000 7fb33aa91640 1 --2- 172.21.15.130:0/347719826 >> v2:172.21.15.130:6816/3863300924 conn(0x7fb318070d60 0x7fb318073220 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.763 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.762+0000 7fb33aa91640 1 --2- 172.21.15.130:0/347719826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb334142c10 0x7fb3340715a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.763 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.762+0000 7fb33aa91640 1 --2- 172.21.15.130:0/347719826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb334142830 0x7fb334071060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.763 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.762+0000 7fb33aa91640 1 --2- 172.21.15.130:0/347719826 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb3340b0950 0x7fb33406ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.763 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.766+0000 7fb33aa91640 1 -- 172.21.15.130:0/347719826 >> 172.21.15.130:0/347719826 conn(0x7fb33406c900 msgr2=0x7fb33413d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:22.763 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.766+0000 7fb33aa91640 1 -- 172.21.15.130:0/347719826 shutdown_connections 2024-06-11T17:18:22.764 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.766+0000 7fb33aa91640 1 -- 172.21.15.130:0/347719826 wait complete. 2024-06-11T17:18:22.772 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.774+0000 7f0465bfd640 1 -- 172.21.15.130:0/3648479871 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f0458036c30 con 0x7f0458039210 2024-06-11T17:18:22.772 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.774+0000 7f045d7fa640 1 -- 172.21.15.130:0/3648479871 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f04600d9430 con 0x7f0458039210 2024-06-11T17:18:22.772 INFO:teuthology.orchestra.run.smithi130.stdout:60129542148 2024-06-11T17:18:22.775 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.7 2024-06-11T17:18:22.776 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.778+0000 7f0465bfd640 1 -- 172.21.15.130:0/3648479871 >> v2:172.21.15.130:6816/3863300924 conn(0x7f0444070db0 msgr2=0x7f0444073270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.776 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.778+0000 7f0465bfd640 1 --2- 172.21.15.130:0/3648479871 >> v2:172.21.15.130:6816/3863300924 conn(0x7f0444070db0 0x7f0444073270 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f045800dcb0 tx=0x7f0454008040 comp rx=0 tx=0).stop 2024-06-11T17:18:22.776 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.778+0000 7f0465bfd640 1 -- 172.21.15.130:0/3648479871 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0458039210 msgr2=0x7f045803be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.776 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.778+0000 7f0465bfd640 1 --2- 172.21.15.130:0/3648479871 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0458039210 0x7f045803be90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0460051170 tx=0x7f0460074730 comp rx=0 tx=0).stop 2024-06-11T17:18:22.776 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.778+0000 7f0465bfd640 1 -- 172.21.15.130:0/3648479871 shutdown_connections 2024-06-11T17:18:22.776 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.778+0000 7f0465bfd640 1 --2- 172.21.15.130:0/3648479871 >> v2:172.21.15.130:6816/3863300924 conn(0x7f0444070db0 0x7f0444073270 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.776 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.778+0000 7f0465bfd640 1 --2- 172.21.15.130:0/3648479871 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04580cb240 0x7f0458033850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.776 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.778+0000 7f0465bfd640 1 --2- 172.21.15.130:0/3648479871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04580c49a0 0x7f0458033310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.776 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.778+0000 7f0465bfd640 1 --2- 172.21.15.130:0/3648479871 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0458039210 0x7f045803be90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.776 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.778+0000 7f0465bfd640 1 -- 172.21.15.130:0/3648479871 >> 172.21.15.130:0/3648479871 conn(0x7f0458006c10 msgr2=0x7f04580c1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:22.776 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.778+0000 7f0465bfd640 1 -- 172.21.15.130:0/3648479871 shutdown_connections 2024-06-11T17:18:22.777 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.778+0000 7f0465bfd640 1 -- 172.21.15.130:0/3648479871 wait complete. 2024-06-11T17:18:22.786 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.0 2024-06-11T17:18:22.786 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574849 for osd.3 2024-06-11T17:18:22.791 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.2 2024-06-11T17:18:22.792 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.794+0000 7f9b24eb4640 1 -- 172.21.15.130:0/3218056384 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9b04005380 con 0x7f9b20144390 2024-06-11T17:18:22.792 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.794+0000 7f9b0effd640 1 -- 172.21.15.130:0/3218056384 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9b1805c9a0 con 0x7f9b20144390 2024-06-11T17:18:22.792 INFO:teuthology.orchestra.run.smithi130.stdout:55834574850 2024-06-11T17:18:22.796 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.798+0000 7f9b24eb4640 1 -- 172.21.15.130:0/3218056384 >> v2:172.21.15.130:6816/3863300924 conn(0x7f9b00070e60 msgr2=0x7f9b00073320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.796 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.798+0000 7f9b24eb4640 1 --2- 172.21.15.130:0/3218056384 >> v2:172.21.15.130:6816/3863300924 conn(0x7f9b00070e60 0x7f9b00073320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9b14009ba0 tx=0x7f9b14009190 comp rx=0 tx=0).stop 2024-06-11T17:18:22.796 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.798+0000 7f9b24eb4640 1 -- 172.21.15.130:0/3218056384 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b20144390 msgr2=0x7f9b2006fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:22.796 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.798+0000 7f9b24eb4640 1 --2- 172.21.15.130:0/3218056384 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b20144390 0x7f9b2006fd10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9b1800caa0 tx=0x7f9b1800cf60 comp rx=0 tx=0).stop 2024-06-11T17:18:22.796 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.798+0000 7f9b24eb4640 1 -- 172.21.15.130:0/3218056384 shutdown_connections 2024-06-11T17:18:22.797 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.798+0000 7f9b24eb4640 1 --2- 172.21.15.130:0/3218056384 >> v2:172.21.15.130:6816/3863300924 conn(0x7f9b00070e60 0x7f9b00073320 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.797 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.798+0000 7f9b24eb4640 1 --2- 172.21.15.130:0/3218056384 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b20144390 0x7f9b2006fd10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.797 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.798+0000 7f9b24eb4640 1 --2- 172.21.15.130:0/3218056384 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9b200ac290 0x7f9b201dee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.797 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.798+0000 7f9b24eb4640 1 --2- 172.21.15.130:0/3218056384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b2006c050 0x7f9b2014a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:22.797 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.798+0000 7f9b24eb4640 1 -- 172.21.15.130:0/3218056384 >> 172.21.15.130:0/3218056384 conn(0x7f9b2006d160 msgr2=0x7f9b20145c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:22.797 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.798+0000 7f9b24eb4640 1 -- 172.21.15.130:0/3218056384 shutdown_connections 2024-06-11T17:18:22.797 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:22.798+0000 7f9b24eb4640 1 -- 172.21.15.130:0/3218056384 wait complete. 2024-06-11T17:18:22.798 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.1 2024-06-11T17:18:22.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.5 2024-06-11T17:18:22.813 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.6 2024-06-11T17:18:23.738 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-06-11T17:18:23.777 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-06-11T17:18:23.787 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-06-11T17:18:23.787 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-06-11T17:18:23.792 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-06-11T17:18:23.799 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-06-11T17:18:23.804 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-06-11T17:18:23.814 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-06-11T17:18:23.892 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.894+0000 7fc81025e640 1 Processor -- start 2024-06-11T17:18:23.893 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.894+0000 7fc81025e640 1 -- start start 2024-06-11T17:18:23.893 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.894+0000 7fc81025e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc80813c310 0x7fc8080ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:23.893 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.894+0000 7fc81025e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8080aebf0 con 0x7fc8080ab250 2024-06-11T17:18:23.893 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.894+0000 7fc81025e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8080abb70 con 0x7fc8080ac530 2024-06-11T17:18:23.893 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.894+0000 7fc81025e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc8080ac910 con 0x7fc80813c310 2024-06-11T17:18:23.893 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.894+0000 7fc80d7f9640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fc8080ab250 0x7fc8080adfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:35430/0 (socket says 172.21.15.130:35430) 2024-06-11T17:18:23.893 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.894+0000 7fc80d7f9640 1 -- 172.21.15.130:0/2449366348 learned_addr learned my addr 172.21.15.130:0/2449366348 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-06-11T17:18:23.894 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.894+0000 7fc80e7fb640 1 --2- 172.21.15.130:0/2449366348 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc80813c310 0x7fc8080ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:23.894 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.894+0000 7fc80e7fb640 1 -- 172.21.15.130:0/2449366348 >> v1:172.21.15.172:6789/0 conn(0x7fc8080ac530 legacy=0x7fc80813bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:23.894 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.894+0000 7fc80e7fb640 1 -- 172.21.15.130:0/2449366348 >> v1:172.21.15.130:6789/0 conn(0x7fc8080ab250 legacy=0x7fc8080adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:23.894 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.894+0000 7fc80e7fb640 1 -- 172.21.15.130:0/2449366348 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8080ad9f0 con 0x7fc80813c310 2024-06-11T17:18:23.897 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.898+0000 7fc80e7fb640 1 --2- 172.21.15.130:0/2449366348 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc80813c310 0x7fc8080ae6b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc7f80097f0 tx=0x7fc7f801bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eeb28fa1df2131cf server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:23.898 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.898+0000 7fc80cff8640 1 -- 172.21.15.130:0/2449366348 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f80a56b0 con 0x7fc80813c310 2024-06-11T17:18:23.898 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.898+0000 7fc80cff8640 1 -- 172.21.15.130:0/2449366348 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7f80a5850 con 0x7fc80813c310 2024-06-11T17:18:23.898 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.898+0000 7fc80cff8640 1 -- 172.21.15.130:0/2449366348 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f80a5c20 con 0x7fc80813c310 2024-06-11T17:18:23.899 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.902+0000 7fc81025e640 1 -- 172.21.15.130:0/2449366348 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc80813c310 msgr2=0x7fc8080ae6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:23.899 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.902+0000 7fc81025e640 1 --2- 172.21.15.130:0/2449366348 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc80813c310 0x7fc8080ae6b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc7f80097f0 tx=0x7fc7f801bee0 comp rx=0 tx=0).stop 2024-06-11T17:18:23.903 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.906+0000 7fc81025e640 1 -- 172.21.15.130:0/2449366348 shutdown_connections 2024-06-11T17:18:23.903 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.906+0000 7fc81025e640 1 --2- 172.21.15.130:0/2449366348 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc80813c310 0x7fc8080ae6b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:23.903 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.906+0000 7fc81025e640 1 -- 172.21.15.130:0/2449366348 >> 172.21.15.130:0/2449366348 conn(0x7fc8080b4ab0 msgr2=0x7fc8080b4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:23.903 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.906+0000 7fc81025e640 1 -- 172.21.15.130:0/2449366348 shutdown_connections 2024-06-11T17:18:23.905 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.906+0000 7fc81025e640 1 -- 172.21.15.130:0/2449366348 wait complete. 2024-06-11T17:18:23.905 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.906+0000 7fc81025e640 1 Processor -- start 2024-06-11T17:18:23.906 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.906+0000 7fc81025e640 1 -- start start 2024-06-11T17:18:23.906 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.906+0000 7fc81025e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8080ac530 0x7fc80813cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:23.906 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.906+0000 7fc81025e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc80813c310 0x7fc80813ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:23.906 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.906+0000 7fc81025e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc808131620 0x7fc808136380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:23.906 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.906+0000 7fc81025e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc80814cfe0 con 0x7fc808131620 2024-06-11T17:18:23.906 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.906+0000 7fc81025e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc80814ce60 con 0x7fc8080ac530 2024-06-11T17:18:23.906 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.906+0000 7fc81025e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc80814d160 con 0x7fc80813c310 2024-06-11T17:18:23.906 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.906+0000 7fc80d7f9640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc80813c310 0x7fc80813ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:23.907 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.906+0000 7fc80d7f9640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc80813c310 0x7fc80813ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:53716/0 (socket says 172.21.15.130:53716) 2024-06-11T17:18:23.907 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.906+0000 7fc80d7f9640 1 -- 172.21.15.130:0/1538131377 learned_addr learned my addr 172.21.15.130:0/1538131377 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:23.907 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.906+0000 7fc80dffa640 1 --2- 172.21.15.130:0/1538131377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8080ac530 0x7fc80813cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:23.907 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.906+0000 7fc80d7f9640 1 -- 172.21.15.130:0/1538131377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8080ac530 msgr2=0x7fc80813cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:23.907 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.906+0000 7fc80d7f9640 1 --2- 172.21.15.130:0/1538131377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8080ac530 0x7fc80813cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:23.907 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.906+0000 7fc80d7f9640 1 -- 172.21.15.130:0/1538131377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc808131620 msgr2=0x7fc808136380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:23.907 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.906+0000 7fc80d7f9640 1 --2- 172.21.15.130:0/1538131377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc808131620 0x7fc808136380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:23.907 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.906+0000 7fc80d7f9640 1 -- 172.21.15.130:0/1538131377 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc808131100 con 0x7fc80813c310 2024-06-11T17:18:23.908 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.910+0000 7fc80d7f9640 1 --2- 172.21.15.130:0/1538131377 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc80813c310 0x7fc80813ebe0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc80000caa0 tx=0x7fc80000cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:23.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.918+0000 7fc7fe7fc640 1 -- 172.21.15.130:0/1538131377 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc800018070 con 0x7fc80813c310 2024-06-11T17:18:23.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.918+0000 7fc81025e640 1 -- 172.21.15.130:0/1538131377 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc80813f120 con 0x7fc80813c310 2024-06-11T17:18:23.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.918+0000 7fc81025e640 1 -- 172.21.15.130:0/1538131377 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc808136a90 con 0x7fc80813c310 2024-06-11T17:18:23.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.918+0000 7fc7fe7fc640 1 -- 172.21.15.130:0/1538131377 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc80000a730 con 0x7fc80813c310 2024-06-11T17:18:23.916 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.918+0000 7fc7fe7fc640 1 -- 172.21.15.130:0/1538131377 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80000ab20 con 0x7fc80813c310 2024-06-11T17:18:23.916 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.918+0000 7fc81025e640 1 -- 172.21.15.130:0/1538131377 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7ec005090 con 0x7fc80813c310 2024-06-11T17:18:23.926 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.926+0000 7fc7fe7fc640 1 -- 172.21.15.130:0/1538131377 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7fc80001b070 con 0x7fc80813c310 2024-06-11T17:18:23.927 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.930+0000 7fc7fe7fc640 1 --2- 172.21.15.130:0/1538131377 >> v2:172.21.15.130:6816/3863300924 conn(0x7fc7f4070f70 0x7fc7f4073430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:23.927 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.930+0000 7fc7fe7fc640 1 -- 172.21.15.130:0/1538131377 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 4090+0+0 (secure 0 0 0) 0x7fc800090290 con 0x7fc80813c310 2024-06-11T17:18:23.927 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.930+0000 7fc80dffa640 1 --2- 172.21.15.130:0/1538131377 >> v2:172.21.15.130:6816/3863300924 conn(0x7fc7f4070f70 0x7fc7f4073430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:23.928 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.930+0000 7fc7fe7fc640 1 -- 172.21.15.130:0/1538131377 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7fc80005c570 con 0x7fc80813c310 2024-06-11T17:18:23.928 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.930+0000 7fc80dffa640 1 --2- 172.21.15.130:0/1538131377 >> v2:172.21.15.130:6816/3863300924 conn(0x7fc7f4070f70 0x7fc7f4073430 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc804001ec0 tx=0x7fc804009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:23.949 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.950+0000 7f34e58ee640 1 Processor -- start 2024-06-11T17:18:23.951 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.950+0000 7f34e58ee640 1 -- start start 2024-06-11T17:18:23.951 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.950+0000 7f34e58ee640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f34e00ac530 0x7f34e013bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:23.951 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.950+0000 7f34e58ee640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34e00abb70 con 0x7f34e00adfa0 2024-06-11T17:18:23.951 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.950+0000 7f34e58ee640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34e00ad9f0 con 0x7f34e00ab250 2024-06-11T17:18:23.951 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.950+0000 7f34e58ee640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f34e00ac910 con 0x7f34e00ac530 2024-06-11T17:18:23.951 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.954+0000 7f34deffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f34e00ac530 0x7f34e013bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:23.951 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.954+0000 7f34deffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f34e00ac530 0x7f34e013bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38576/0 (socket says 172.21.15.130:38576) 2024-06-11T17:18:23.951 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.954+0000 7f34deffd640 1 -- 172.21.15.130:0/4170760189 learned_addr learned my addr 172.21.15.130:0/4170760189 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:23.951 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.954+0000 7f34df7fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f34e00adfa0 0x7f34e00ae3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:35436/0 (socket says 172.21.15.130:35436) 2024-06-11T17:18:23.954 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.954+0000 7f34deffd640 1 -- 172.21.15.130:0/4170760189 >> v1:172.21.15.172:6789/0 conn(0x7f34e00ab250 legacy=0x7f34e013c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:23.954 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.954+0000 7f34deffd640 1 -- 172.21.15.130:0/4170760189 >> v1:172.21.15.130:6789/0 conn(0x7f34e00adfa0 legacy=0x7f34e00ae3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:23.954 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.954+0000 7f34deffd640 1 -- 172.21.15.130:0/4170760189 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34e00ab6e0 con 0x7f34e00ac530 2024-06-11T17:18:23.955 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.958+0000 7f34deffd640 1 --2- 172.21.15.130:0/4170760189 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34e00ac530 0x7f34e013bc00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f34d800ca00 tx=0x7f34d801ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce699cc4b5c34284 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:23.955 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.958+0000 7f34ddffb640 1 -- 172.21.15.130:0/4170760189 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d80b3070 con 0x7f34e00ac530 2024-06-11T17:18:23.956 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.958+0000 7f34ddffb640 1 -- 172.21.15.130:0/4170760189 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d80092d0 con 0x7f34e00ac530 2024-06-11T17:18:23.956 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.958+0000 7f34ddffb640 1 -- 172.21.15.130:0/4170760189 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d80096e0 con 0x7f34e00ac530 2024-06-11T17:18:23.956 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.958+0000 7f34e58ee640 1 -- 172.21.15.130:0/4170760189 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34e00ac530 msgr2=0x7f34e013bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:23.956 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.958+0000 7f34e58ee640 1 --2- 172.21.15.130:0/4170760189 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34e00ac530 0x7f34e013bc00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f34d800ca00 tx=0x7f34d801ee60 comp rx=0 tx=0).stop 2024-06-11T17:18:23.957 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.958+0000 7f34e58ee640 1 -- 172.21.15.130:0/4170760189 shutdown_connections 2024-06-11T17:18:23.957 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.958+0000 7f34e58ee640 1 --2- 172.21.15.130:0/4170760189 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34e00ac530 0x7f34e013bc00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:23.957 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.958+0000 7f34e58ee640 1 -- 172.21.15.130:0/4170760189 >> 172.21.15.130:0/4170760189 conn(0x7f34e00b4ab0 msgr2=0x7f34e00b4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:23.957 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.958+0000 7f34e58ee640 1 -- 172.21.15.130:0/4170760189 shutdown_connections 2024-06-11T17:18:23.959 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.958+0000 7f34e58ee640 1 -- 172.21.15.130:0/4170760189 wait complete. 2024-06-11T17:18:23.959 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.962+0000 7f34e58ee640 1 Processor -- start 2024-06-11T17:18:23.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.962+0000 7f34e58ee640 1 -- start start 2024-06-11T17:18:23.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.962+0000 7f34e58ee640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34e00ac530 0x7f34e01421b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:23.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.962+0000 7f34e58ee640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34e00adfa0 0x7f34e01e7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:23.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.962+0000 7f34e58ee640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34e006fff0 0x7f34e01e8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:23.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.962+0000 7f34e58ee640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f34e014d020 con 0x7f34e006fff0 2024-06-11T17:18:23.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.962+0000 7f34e58ee640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f34e014cea0 con 0x7f34e00ac530 2024-06-11T17:18:23.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.962+0000 7f34e58ee640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f34e014d1a0 con 0x7f34e00adfa0 2024-06-11T17:18:23.961 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.962+0000 7f34de7fc640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34e00adfa0 0x7f34e01e7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:23.961 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.962+0000 7f34df7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34e006fff0 0x7f34e01e8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:23.961 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.962+0000 7f34de7fc640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34e00adfa0 0x7f34e01e7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:53722/0 (socket says 172.21.15.130:53722) 2024-06-11T17:18:23.961 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.962+0000 7f34df7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34e006fff0 0x7f34e01e8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38580/0 (socket says 172.21.15.130:38580) 2024-06-11T17:18:23.961 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.962+0000 7f34de7fc640 1 -- 172.21.15.130:0/2878269795 learned_addr learned my addr 172.21.15.130:0/2878269795 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:23.961 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.962+0000 7f34deffd640 1 --2- 172.21.15.130:0/2878269795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34e00ac530 0x7f34e01421b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:23.962 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.962+0000 7f34df7fe640 1 -- 172.21.15.130:0/2878269795 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34e00adfa0 msgr2=0x7f34e01e7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:23.962 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.962+0000 7f34df7fe640 1 --2- 172.21.15.130:0/2878269795 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34e00adfa0 0x7f34e01e7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:23.962 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.962+0000 7f34df7fe640 1 -- 172.21.15.130:0/2878269795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34e00ac530 msgr2=0x7f34e01421b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:23.962 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.962+0000 7f34df7fe640 1 --2- 172.21.15.130:0/2878269795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34e00ac530 0x7f34e01421b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:23.962 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.962+0000 7f34df7fe640 1 -- 172.21.15.130:0/2878269795 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34e0070e70 con 0x7f34e006fff0 2024-06-11T17:18:23.962 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.962+0000 7f34deffd640 1 --2- 172.21.15.130:0/2878269795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34e00ac530 0x7f34e01421b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-11T17:18:23.962 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.962+0000 7f34de7fc640 1 --2- 172.21.15.130:0/2878269795 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34e00adfa0 0x7f34e01e7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:18:23.962 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.962+0000 7f34df7fe640 1 --2- 172.21.15.130:0/2878269795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34e006fff0 0x7f34e01e8080 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f34d400b410 tx=0x7f34d400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:23.962 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.962+0000 7f34c7fff640 1 -- 172.21.15.130:0/2878269795 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d4015020 con 0x7f34e006fff0 2024-06-11T17:18:23.964 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.962+0000 7f34e58ee640 1 -- 172.21.15.130:0/2878269795 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34e01e5680 con 0x7f34e006fff0 2024-06-11T17:18:23.964 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.962+0000 7f34e58ee640 1 -- 172.21.15.130:0/2878269795 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34e0070b20 con 0x7f34e006fff0 2024-06-11T17:18:23.966 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.962+0000 7f34c7fff640 1 -- 172.21.15.130:0/2878269795 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d4011830 con 0x7f34e006fff0 2024-06-11T17:18:23.967 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.970+0000 7f34c7fff640 1 -- 172.21.15.130:0/2878269795 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d4011c20 con 0x7f34e006fff0 2024-06-11T17:18:23.967 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.970+0000 7f34c7fff640 1 -- 172.21.15.130:0/2878269795 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f34d4018020 con 0x7f34e006fff0 2024-06-11T17:18:23.968 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.970+0000 7f34c7fff640 1 --2- 172.21.15.130:0/2878269795 >> v2:172.21.15.130:6816/3863300924 conn(0x7f34cc070e60 0x7f34cc073320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:23.969 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.970+0000 7f34c7fff640 1 -- 172.21.15.130:0/2878269795 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4090+0+0 (secure 0 0 0) 0x7f34d4090810 con 0x7f34e006fff0 2024-06-11T17:18:23.969 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.970+0000 7f34deffd640 1 --2- 172.21.15.130:0/2878269795 >> v2:172.21.15.130:6816/3863300924 conn(0x7f34cc070e60 0x7f34cc073320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:23.970 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.970+0000 7f34deffd640 1 --2- 172.21.15.130:0/2878269795 >> v2:172.21.15.130:6816/3863300924 conn(0x7f34cc070e60 0x7f34cc073320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f34d80b0000 tx=0x7f34d80a9000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:23.970 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.970+0000 7f34e58ee640 1 -- 172.21.15.130:0/2878269795 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34c0005090 con 0x7f34e006fff0 2024-06-11T17:18:23.979 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:23.982+0000 7f34c7fff640 1 -- 172.21.15.130:0/2878269795 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7f34d401f020 con 0x7f34e006fff0 2024-06-11T17:18:23.999 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.002+0000 7f4fd9bc6640 1 Processor -- start 2024-06-11T17:18:24.000 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.002+0000 7f4fd9bc6640 1 -- start start 2024-06-11T17:18:24.000 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.002+0000 7f4fd9bc6640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4fcc034880 0x7f4fcc0c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.000 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.002+0000 7f4fd9bc6640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4fcc02aed0 0x7f4fcc02b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.001 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.002+0000 7f4fd9bc6640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fcc02c700 con 0x7f4fcc0344a0 2024-06-11T17:18:24.001 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.002+0000 7f4fd9bc6640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f4fcc02a760 con 0x7f4fcc02aed0 2024-06-11T17:18:24.001 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.002+0000 7f4fd9bc6640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f4fcc0c1020 con 0x7f4fcc034880 2024-06-11T17:18:24.001 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.002+0000 7f4fd37fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f4fcc0344a0 0x7f4fcc0322c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:35444/0 (socket says 172.21.15.130:35444) 2024-06-11T17:18:24.001 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.002+0000 7f4fd37fe640 1 -- 172.21.15.130:0/1360751788 learned_addr learned my addr 172.21.15.130:0/1360751788 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-06-11T17:18:24.001 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.002+0000 7f4fd2ffd640 1 --2- 172.21.15.130:0/1360751788 >> v2:172.21.15.172:3300/0 conn(0x7f4fcc034880 0x7f4fcc0c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.001 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.002+0000 7f4fd3fff640 1 --2- 172.21.15.130:0/1360751788 >> v2:172.21.15.130:3300/0 conn(0x7f4fcc02aed0 0x7f4fcc02b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.002 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.002+0000 7f4fd2ffd640 1 -- 172.21.15.130:0/1360751788 >> v2:172.21.15.130:3300/0 conn(0x7f4fcc02aed0 msgr2=0x7f4fcc02b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:24.002 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.002+0000 7f4fd2ffd640 1 --2- 172.21.15.130:0/1360751788 >> v2:172.21.15.130:3300/0 conn(0x7f4fcc02aed0 0x7f4fcc02b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.002 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.002+0000 7f4fd2ffd640 1 -- 172.21.15.130:0/1360751788 >> v1:172.21.15.130:6789/0 conn(0x7f4fcc0344a0 legacy=0x7f4fcc0322c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.003 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.002+0000 7f4fd2ffd640 1 -- 172.21.15.130:0/1360751788 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fcc02a9b0 con 0x7f4fcc034880 2024-06-11T17:18:24.003 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.002+0000 7f4fd3fff640 1 --2- 172.21.15.130:0/1360751788 >> v2:172.21.15.130:3300/0 conn(0x7f4fcc02aed0 0x7f4fcc02b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-11T17:18:24.004 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.006+0000 7f2550ecb640 1 Processor -- start 2024-06-11T17:18:24.004 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.006+0000 7f2550ecb640 1 -- start start 2024-06-11T17:18:24.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.006+0000 7f4fd2ffd640 1 --2- 172.21.15.130:0/1360751788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fcc034880 0x7f4fcc0c6a60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc0c7af0 tx=0x7f4fc801e680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac17fb4404852b5f server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:24.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.006+0000 7f4fd27fc640 1 -- 172.21.15.130:0/1360751788 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc80ab5f0 con 0x7f4fcc034880 2024-06-11T17:18:24.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.006+0000 7f4fd27fc640 1 -- 172.21.15.130:0/1360751788 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fc80ab790 con 0x7f4fcc034880 2024-06-11T17:18:24.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.006+0000 7f4fd27fc640 1 -- 172.21.15.130:0/1360751788 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc80abb60 con 0x7f4fcc034880 2024-06-11T17:18:24.006 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.006+0000 7f2550ecb640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f254c0b4dc0 0x7f254c0ab600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.006 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.006+0000 7f2550ecb640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f254c0ae9c0 0x7f254c13bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.006 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.006+0000 7f2550ecb640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f254c13c460 0x7f254c13ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.006 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.006+0000 7f2550ecb640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f254c0abf70 con 0x7f254c0ae9c0 2024-06-11T17:18:24.006 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.006+0000 7f2550ecb640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f254c0abb40 con 0x7f254c0b4dc0 2024-06-11T17:18:24.006 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.006+0000 7f2550ecb640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f254c0abcc0 con 0x7f254c13c460 2024-06-11T17:18:24.006 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.006+0000 7f2549d9b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f254c0ae9c0 0x7f254c13bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.007 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.006+0000 7fd5de402640 1 Processor -- start 2024-06-11T17:18:24.007 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.006+0000 7f2549d9b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f254c0ae9c0 0x7f254c13bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38596/0 (socket says 172.21.15.130:38596) 2024-06-11T17:18:24.007 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.006+0000 7f2549d9b640 1 -- 172.21.15.130:0/771799365 learned_addr learned my addr 172.21.15.130:0/771799365 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:24.007 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.006+0000 7f254a59c640 1 --2- 172.21.15.130:0/771799365 >> v2:172.21.15.172:3300/0 conn(0x7f254c0b4dc0 0x7f254c0ab600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.007 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.006+0000 7f254ad9d640 1 --2- 172.21.15.130:0/771799365 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f254c13c460 0x7f254c13ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.007 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.006+0000 7f2549d9b640 1 -- 172.21.15.130:0/771799365 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f254c13c460 msgr2=0x7f254c13ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:24.008 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.006+0000 7f2549d9b640 1 --2- 172.21.15.130:0/771799365 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f254c13c460 0x7f254c13ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.008 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.006+0000 7f2549d9b640 1 -- 172.21.15.130:0/771799365 >> v2:172.21.15.172:3300/0 conn(0x7f254c0b4dc0 msgr2=0x7f254c0ab600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:24.008 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.006+0000 7f2549d9b640 1 --2- 172.21.15.130:0/771799365 >> v2:172.21.15.172:3300/0 conn(0x7f254c0b4dc0 0x7f254c0ab600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.008 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.006+0000 7f2549d9b640 1 -- 172.21.15.130:0/771799365 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f254c0aaa20 con 0x7f254c0ae9c0 2024-06-11T17:18:24.008 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.006+0000 7f4fd9bc6640 1 -- 172.21.15.130:0/1360751788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fcc034880 msgr2=0x7f4fcc0c6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.008 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.006+0000 7f4fd9bc6640 1 --2- 172.21.15.130:0/1360751788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fcc034880 0x7f4fcc0c6a60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc0c7af0 tx=0x7f4fc801e680 comp rx=0 tx=0).stop 2024-06-11T17:18:24.008 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.006+0000 7f9312a5f640 1 Processor -- start 2024-06-11T17:18:24.009 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.006+0000 7fd5de402640 1 -- start start 2024-06-11T17:18:24.009 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.006+0000 7f9312a5f640 1 -- start start 2024-06-11T17:18:24.009 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.006+0000 7f4fd9bc6640 1 -- 172.21.15.130:0/1360751788 shutdown_connections 2024-06-11T17:18:24.009 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.006+0000 7f4fd9bc6640 1 --2- 172.21.15.130:0/1360751788 >> v2:172.21.15.130:3300/0 conn(0x7f4fcc02aed0 0x7f4fcc02b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.010 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.006+0000 7f4fd9bc6640 1 --2- 172.21.15.130:0/1360751788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fcc034880 0x7f4fcc0c6a60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.010 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.006+0000 7f4fd9bc6640 1 -- 172.21.15.130:0/1360751788 >> 172.21.15.130:0/1360751788 conn(0x7f4fcc005a10 msgr2=0x7f4fcc005df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:24.010 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.006+0000 7f4fd9bc6640 1 -- 172.21.15.130:0/1360751788 shutdown_connections 2024-06-11T17:18:24.010 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7f9312a5f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f930c0ab100 0x7f930c0abd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.010 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7fd5de402640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5d0006f50 0x7fd5d0008c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.011 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7fd5dd400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5d0006f50 0x7fd5d0008c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.011 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7fd5dd400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5d0006f50 0x7fd5d0008c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:53756/0 (socket says 172.21.15.130:53756) 2024-06-11T17:18:24.011 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7fd5de402640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd5d0009510 0x7fd5d00cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.011 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7f930bfff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f930c0ab100 0x7f930c0abd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.011 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7f930bfff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f930c0ab100 0x7f930c0abd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:53744/0 (socket says 172.21.15.130:53744) 2024-06-11T17:18:24.011 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7f930bfff640 1 -- 172.21.15.130:0/2047211675 learned_addr learned my addr 172.21.15.130:0/2047211675 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:24.012 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7fd5dd400640 1 -- 172.21.15.130:0/127850283 learned_addr learned my addr 172.21.15.130:0/127850283 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:24.012 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7f9312a5f640 1 --2- 172.21.15.130:0/2047211675 >> v2:172.21.15.130:3300/0 conn(0x7f930c143020 0x7f930c13c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.012 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7fd5de402640 1 -- 172.21.15.130:0/127850283 --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5d0008700 con 0x7fd5d0035100 2024-06-11T17:18:24.012 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7fd5de402640 1 -- 172.21.15.130:0/127850283 --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fd5d0007330 con 0x7fd5d0009510 2024-06-11T17:18:24.013 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7f9312a5f640 1 -- 172.21.15.130:0/2047211675 --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f930c0ad3d0 con 0x7f930c13c490 2024-06-11T17:18:24.013 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7fd5de402640 1 -- 172.21.15.130:0/127850283 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fd5d0009140 con 0x7fd5d0006f50 2024-06-11T17:18:24.013 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7f9312a5f640 1 -- 172.21.15.130:0/2047211675 --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f930c0ab4e0 con 0x7f930c143020 2024-06-11T17:18:24.013 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7f9312a5f640 1 -- 172.21.15.130:0/2047211675 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f930c13f030 con 0x7f930c0ab100 2024-06-11T17:18:24.014 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.006+0000 7f4fd9bc6640 1 -- 172.21.15.130:0/1360751788 wait complete. 2024-06-11T17:18:24.014 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7f4fd9bc6640 1 Processor -- start 2024-06-11T17:18:24.014 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7fd5dcbff640 1 --2- 172.21.15.130:0/127850283 >> v2:172.21.15.172:3300/0 conn(0x7fd5d0009510 0x7fd5d00cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.014 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7f930bfff640 1 -- 172.21.15.130:0/2047211675 >> v2:172.21.15.130:3300/0 conn(0x7f930c143020 msgr2=0x7f930c13c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:24.014 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7f930bfff640 1 --2- 172.21.15.130:0/2047211675 >> v2:172.21.15.130:3300/0 conn(0x7f930c143020 0x7f930c13c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.014 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7f930bfff640 1 -- 172.21.15.130:0/2047211675 >> v1:172.21.15.172:6789/0 conn(0x7f930c13c490 legacy=0x7f930c142910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:24.014 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7f930bfff640 1 -- 172.21.15.130:0/2047211675 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f930c0ac240 con 0x7f930c0ab100 2024-06-11T17:18:24.015 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7fd5cffff640 1 -- 172.21.15.130:0/127850283 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1582735015 0 0) 0x7fd5d0008700 con 0x7fd5d0035100 2024-06-11T17:18:24.015 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7fd5cffff640 1 -- 172.21.15.130:0/127850283 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5c4003530 con 0x7fd5d0035100 2024-06-11T17:18:24.015 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7fd5dd400640 1 -- 172.21.15.130:0/127850283 >> v2:172.21.15.172:3300/0 conn(0x7fd5d0009510 msgr2=0x7fd5d00cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:24.015 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7fd5dd400640 1 --2- 172.21.15.130:0/127850283 >> v2:172.21.15.172:3300/0 conn(0x7fd5d0009510 0x7fd5d00cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.015 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7fd5dd400640 1 -- 172.21.15.130:0/127850283 >> v1:172.21.15.172:6789/0 conn(0x7fd5d0035100 legacy=0x7fd5d00c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.015 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7fd5dd400640 1 -- 172.21.15.130:0/127850283 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d00cf320 con 0x7fd5d0006f50 2024-06-11T17:18:24.015 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7f4fd9bc6640 1 -- start start 2024-06-11T17:18:24.015 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7f4fd9bc6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fcc02aed0 0x7f4fcc0b9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.016 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7f4fd9bc6640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4fcc0344a0 0x7f4fcc0b9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.016 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7f4fd9bc6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fcc0b89f0 0x7f4fcc0b8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.016 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7f4fd9bc6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4fcc0d09a0 con 0x7f4fcc0b89f0 2024-06-11T17:18:24.016 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7f4fd9bc6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4fcc0d0820 con 0x7f4fcc02aed0 2024-06-11T17:18:24.016 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7f4fd9bc6640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4fcc0d0b20 con 0x7f4fcc0344a0 2024-06-11T17:18:24.016 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7f2549d9b640 1 --2- 172.21.15.130:0/771799365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f254c0ae9c0 0x7f254c13bf20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f254c0b56c0 tx=0x7f254401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db8aa8f16a91c1f server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:24.017 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7f4fd37fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fcc02aed0 0x7f4fcc0b9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.017 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7f4fd3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fcc0b89f0 0x7f4fcc0b8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.017 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7f4fd37fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fcc02aed0 0x7f4fcc0b9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.130:57416/0 (socket says 172.21.15.130:57416) 2024-06-11T17:18:24.017 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7f4fd37fe640 1 -- 172.21.15.130:0/808180480 learned_addr learned my addr 172.21.15.130:0/808180480 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:24.017 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7f4fd3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fcc0b89f0 0x7f4fcc0b8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38616/0 (socket says 172.21.15.130:38616) 2024-06-11T17:18:24.018 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7f4fd2ffd640 1 --2- 172.21.15.130:0/808180480 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4fcc0344a0 0x7f4fcc0b9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.018 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7f4fd3fff640 1 -- 172.21.15.130:0/808180480 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4fcc0344a0 msgr2=0x7f4fcc0b9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.018 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7f4fd3fff640 1 --2- 172.21.15.130:0/808180480 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4fcc0344a0 0x7f4fcc0b9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.018 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7f4fd3fff640 1 -- 172.21.15.130:0/808180480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fcc02aed0 msgr2=0x7f4fcc0b9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.018 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7f4fd3fff640 1 --2- 172.21.15.130:0/808180480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fcc02aed0 0x7f4fcc0b9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.018 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7f4fd3fff640 1 -- 172.21.15.130:0/808180480 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fcc0c1e20 con 0x7f4fcc0b89f0 2024-06-11T17:18:24.018 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7f4fd37fe640 1 --2- 172.21.15.130:0/808180480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fcc02aed0 0x7f4fcc0b9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:18:24.018 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.010+0000 7f4fd3fff640 1 --2- 172.21.15.130:0/808180480 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fcc0b89f0 0x7f4fcc0b8e70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4fc000e600 tx=0x7f4fc000eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:24.018 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f4fbffff640 1 -- 172.21.15.130:0/808180480 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0017070 con 0x7f4fcc0b89f0 2024-06-11T17:18:24.018 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f4fbffff640 1 -- 172.21.15.130:0/808180480 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fc000c620 con 0x7f4fcc0b89f0 2024-06-11T17:18:24.018 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f4fbffff640 1 -- 172.21.15.130:0/808180480 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc000f040 con 0x7f4fcc0b89f0 2024-06-11T17:18:24.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f254959a640 1 -- 172.21.15.130:0/771799365 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254400b2d0 con 0x7f254c0ae9c0 2024-06-11T17:18:24.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f254959a640 1 -- 172.21.15.130:0/771799365 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f254400b470 con 0x7f254c0ae9c0 2024-06-11T17:18:24.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f254959a640 1 -- 172.21.15.130:0/771799365 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25440a5ab0 con 0x7f254c0ae9c0 2024-06-11T17:18:24.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f930bfff640 1 --2- 172.21.15.130:0/2047211675 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f930c0ab100 0x7f930c0abd00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f930400af60 tx=0x7f930401ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3428024a0cbd4030 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:24.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f473b59e640 1 Processor -- start 2024-06-11T17:18:24.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f930affd640 1 -- 172.21.15.130:0/2047211675 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930400a2d0 con 0x7f930c0ab100 2024-06-11T17:18:24.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7fd5dd400640 1 --2- 172.21.15.130:0/127850283 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5d0006f50 0x7fd5d0008c00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4009870 tx=0x7fd5d401c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f35838587c608d0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:24.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f930affd640 1 -- 172.21.15.130:0/2047211675 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93040a77f0 con 0x7f930c0ab100 2024-06-11T17:18:24.021 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7fd5cffff640 1 -- 172.21.15.130:0/127850283 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d40a6040 con 0x7fd5d0006f50 2024-06-11T17:18:24.021 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7fd5cffff640 1 -- 172.21.15.130:0/127850283 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5d40af070 con 0x7fd5d0006f50 2024-06-11T17:18:24.021 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7fd5cffff640 1 -- 172.21.15.130:0/127850283 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d40aa860 con 0x7fd5d0006f50 2024-06-11T17:18:24.021 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f2550ecb640 1 -- 172.21.15.130:0/771799365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f254c0ae9c0 msgr2=0x7f254c13bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.021 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f2550ecb640 1 --2- 172.21.15.130:0/771799365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f254c0ae9c0 0x7f254c13bf20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f254c0b56c0 tx=0x7f254401c9d0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.021 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f4fd9bc6640 1 -- 172.21.15.130:0/808180480 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fcc0c2090 con 0x7f4fcc0b89f0 2024-06-11T17:18:24.021 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f4fd9bc6640 1 -- 172.21.15.130:0/808180480 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fcc0c41c0 con 0x7f4fcc0b89f0 2024-06-11T17:18:24.022 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f9312a5f640 1 -- 172.21.15.130:0/2047211675 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f930c0ab100 msgr2=0x7f930c0abd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.022 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f9312a5f640 1 --2- 172.21.15.130:0/2047211675 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f930c0ab100 0x7f930c0abd00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f930400af60 tx=0x7f930401ec20 comp rx=0 tx=0).stop 2024-06-11T17:18:24.022 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f9312a5f640 1 -- 172.21.15.130:0/2047211675 shutdown_connections 2024-06-11T17:18:24.022 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f9312a5f640 1 --2- 172.21.15.130:0/2047211675 >> v2:172.21.15.130:3300/0 conn(0x7f930c143020 0x7f930c13c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.022 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f9312a5f640 1 --2- 172.21.15.130:0/2047211675 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f930c0ab100 0x7f930c0abd00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.022 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f9312a5f640 1 -- 172.21.15.130:0/2047211675 >> 172.21.15.130:0/2047211675 conn(0x7f930c0b46b0 msgr2=0x7f930c0b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:24.023 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f473b59e640 1 -- start start 2024-06-11T17:18:24.023 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f473b59e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f473c13f730 0x7f473c0ac690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.023 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f473b59e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f473c0ab870 0x7f473c073eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.023 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f473b59e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f473c142770 con 0x7f473c0ab490 2024-06-11T17:18:24.023 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f473b59e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f473c13f210 con 0x7f473c0ab870 2024-06-11T17:18:24.023 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f473b59e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f473c0ac3d0 con 0x7f473c13f730 2024-06-11T17:18:24.023 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f473a59c640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f473c0ab490 0x7f473c142060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:35450/0 (socket says 172.21.15.130:35450) 2024-06-11T17:18:24.023 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f473a59c640 1 -- 172.21.15.130:0/609074980 learned_addr learned my addr 172.21.15.130:0/609074980 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-06-11T17:18:24.024 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7fd5de402640 1 -- 172.21.15.130:0/127850283 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5d0006f50 msgr2=0x7fd5d0008c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.024 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7fd5de402640 1 --2- 172.21.15.130:0/127850283 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5d0006f50 0x7fd5d0008c00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4009870 tx=0x7fd5d401c540 comp rx=0 tx=0).stop 2024-06-11T17:18:24.024 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7fd5de402640 1 -- 172.21.15.130:0/127850283 shutdown_connections 2024-06-11T17:18:24.024 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7fd5de402640 1 --2- 172.21.15.130:0/127850283 >> v2:172.21.15.172:3300/0 conn(0x7fd5d0009510 0x7fd5d00cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.024 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7fd5de402640 1 --2- 172.21.15.130:0/127850283 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5d0006f50 0x7fd5d0008c00 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4009870 tx=0x7fd5d401c540 comp rx=0 tx=0).stop 2024-06-11T17:18:24.024 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7fd5de402640 1 -- 172.21.15.130:0/127850283 >> 172.21.15.130:0/127850283 conn(0x7fd5d0005d80 msgr2=0x7fd5d0006160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:24.024 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f473ad9d640 1 --2- 172.21.15.130:0/609074980 >> v2:172.21.15.130:3300/0 conn(0x7f473c0ab870 0x7f473c073eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.025 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f9312a5f640 1 -- 172.21.15.130:0/2047211675 shutdown_connections 2024-06-11T17:18:24.025 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f9312a5f640 1 -- 172.21.15.130:0/2047211675 wait complete. 2024-06-11T17:18:24.025 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7fd5de402640 1 -- 172.21.15.130:0/127850283 shutdown_connections 2024-06-11T17:18:24.025 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f4739d9b640 1 --2- 172.21.15.130:0/609074980 >> v2:172.21.15.172:3300/0 conn(0x7f473c13f730 0x7f473c0ac690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.026 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7fd5de402640 1 -- 172.21.15.130:0/127850283 wait complete. 2024-06-11T17:18:24.026 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f473ad9d640 1 -- 172.21.15.130:0/609074980 >> v2:172.21.15.172:3300/0 conn(0x7f473c13f730 msgr2=0x7f473c0ac690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:24.027 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f473ad9d640 1 --2- 172.21.15.130:0/609074980 >> v2:172.21.15.172:3300/0 conn(0x7f473c13f730 0x7f473c0ac690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.027 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f473ad9d640 1 -- 172.21.15.130:0/609074980 >> v1:172.21.15.130:6789/0 conn(0x7f473c0ab490 legacy=0x7f473c142060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.027 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7fd5de402640 1 Processor -- start 2024-06-11T17:18:24.027 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f9312a5f640 1 Processor -- start 2024-06-11T17:18:24.027 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f9312a5f640 1 -- start start 2024-06-11T17:18:24.028 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f473ad9d640 1 -- 172.21.15.130:0/609074980 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f473c0743f0 con 0x7f473c0ab870 2024-06-11T17:18:24.028 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7fd5de402640 1 -- start start 2024-06-11T17:18:24.028 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f14e353d640 1 Processor -- start 2024-06-11T17:18:24.028 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f14e353d640 1 -- start start 2024-06-11T17:18:24.029 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.014+0000 7f14e353d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f14dc0ac210 0x7f14dc157410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.029 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f9312a5f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f930c13c490 0x7f930c0b3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.029 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f9312a5f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f930c143020 0x7f930c13ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.029 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f9312a5f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f930c06f430 0x7f930c135620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.029 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f9312a5f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f930c14c410 con 0x7f930c143020 2024-06-11T17:18:24.029 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f9312a5f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f930c14c290 con 0x7f930c06f430 2024-06-11T17:18:24.029 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7fd5de402640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd5d0009510 0x7fd5d00d3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.029 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7fd5de402640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5d0035100 0x7fd5d00c5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.029 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7fd5de402640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5d00c5da0 0x7fd5d0164320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.030 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7fd5de402640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d00d8d80 con 0x7fd5d0009510 2024-06-11T17:18:24.030 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7fd5de402640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d00d8c00 con 0x7fd5d0035100 2024-06-11T17:18:24.030 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7fd5de402640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fd5d00d8f00 con 0x7fd5d00c5da0 2024-06-11T17:18:24.030 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f9312a5f640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f930c14c590 con 0x7f930c13c490 2024-06-11T17:18:24.030 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f9310ffc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f930c06f430 0x7f930c135620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.030 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f9310ffc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f930c06f430 0x7f930c135620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.130:57444/0 (socket says 172.21.15.130:57444) 2024-06-11T17:18:24.030 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f9310ffc640 1 -- 172.21.15.130:0/3771360782 learned_addr learned my addr 172.21.15.130:0/3771360782 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:24.030 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f930bfff640 1 --2- 172.21.15.130:0/3771360782 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f930c13c490 0x7f930c0b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7fd5dcbff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5d0035100 0x7fd5d00c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f4fbffff640 1 -- 172.21.15.130:0/808180480 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f4fc001a070 con 0x7f4fcc0b89f0 2024-06-11T17:18:24.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f4fbffff640 1 --2- 172.21.15.130:0/808180480 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4fb8070e30 0x7f4fb80732f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f4fbffff640 1 -- 172.21.15.130:0/808180480 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4090+0+0 (secure 0 0 0) 0x7f4fc00900d0 con 0x7f4fcc0b89f0 2024-06-11T17:18:24.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f4fd37fe640 1 --2- 172.21.15.130:0/808180480 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4fb8070e30 0x7f4fb80732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.032 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7fd5dcbff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5d0035100 0x7fd5d00c5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.130:57448/0 (socket says 172.21.15.130:57448) 2024-06-11T17:18:24.032 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7fd5dcbff640 1 -- 172.21.15.130:0/1123855205 learned_addr learned my addr 172.21.15.130:0/1123855205 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:24.032 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f930bfff640 1 -- 172.21.15.130:0/3771360782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f930c06f430 msgr2=0x7f930c135620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.032 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f930bfff640 1 --2- 172.21.15.130:0/3771360782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f930c06f430 0x7f930c135620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.032 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f930bfff640 1 -- 172.21.15.130:0/3771360782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f930c143020 msgr2=0x7f930c13ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.032 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f930bfff640 1 --2- 172.21.15.130:0/3771360782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f930c143020 0x7f930c13ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.032 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f930bfff640 1 -- 172.21.15.130:0/3771360782 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f930c13bfd0 con 0x7f930c13c490 2024-06-11T17:18:24.032 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f9310ffc640 1 --2- 172.21.15.130:0/3771360782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f930c06f430 0x7f930c135620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:18:24.033 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f4fd37fe640 1 --2- 172.21.15.130:0/808180480 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4fb8070e30 0x7f4fb80732f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4fd407b660 tx=0x7f4fd4068e50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:24.033 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f2550ecb640 1 -- 172.21.15.130:0/771799365 shutdown_connections 2024-06-11T17:18:24.033 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f2550ecb640 1 --2- 172.21.15.130:0/771799365 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f254c13c460 0x7f254c13ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.033 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f2550ecb640 1 --2- 172.21.15.130:0/771799365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f254c0ae9c0 0x7f254c13bf20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.033 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f2550ecb640 1 --2- 172.21.15.130:0/771799365 >> v2:172.21.15.172:3300/0 conn(0x7f254c0b4dc0 0x7f254c0ab600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.033 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f2550ecb640 1 -- 172.21.15.130:0/771799365 >> 172.21.15.130:0/771799365 conn(0x7f254c06c9d0 msgr2=0x7f254c0b46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:24.034 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f930bfff640 1 --2- 172.21.15.130:0/3771360782 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f930c13c490 0x7f930c0b3390 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f930c06db70 tx=0x7f930401b9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:24.034 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7fd5dcbff640 1 -- 172.21.15.130:0/1123855205 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5d00c5da0 msgr2=0x7fd5d0164320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.034 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7fd5dcbff640 1 --2- 172.21.15.130:0/1123855205 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5d00c5da0 0x7fd5d0164320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.034 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7fd5dcbff640 1 -- 172.21.15.130:0/1123855205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd5d0009510 msgr2=0x7fd5d00d3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.034 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7fd5dcbff640 1 --2- 172.21.15.130:0/1123855205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd5d0009510 0x7fd5d00d3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.034 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7fd5dcbff640 1 -- 172.21.15.130:0/1123855205 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d002c990 con 0x7fd5d0035100 2024-06-11T17:18:24.034 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f2550ecb640 1 -- 172.21.15.130:0/771799365 shutdown_connections 2024-06-11T17:18:24.035 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f473ad9d640 1 --2- 172.21.15.130:0/609074980 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f473c0ab870 0x7f473c073eb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f473c0ad2c0 tx=0x7f472c01c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6b690661cadae46 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:24.035 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f14e0ad8640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f14dc0ac210 0x7f14dc157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.035 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f14e0ad8640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f14dc0ac210 0x7f14dc157410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:53776/0 (socket says 172.21.15.130:53776) 2024-06-11T17:18:24.035 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f14e0ad8640 1 -- 172.21.15.130:0/1993520497 learned_addr learned my addr 172.21.15.130:0/1993520497 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:24.035 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f14e353d640 1 -- 172.21.15.130:0/1993520497 --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14dc0ad9b0 con 0x7f14dc0abe30 2024-06-11T17:18:24.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f14e353d640 1 -- 172.21.15.130:0/1993520497 --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14dc0aa480 con 0x7f14dc157950 2024-06-11T17:18:24.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f14e353d640 1 -- 172.21.15.130:0/1993520497 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f14dc0b02f0 con 0x7f14dc0ac210 2024-06-11T17:18:24.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f14e0ad8640 1 -- 172.21.15.130:0/1993520497 >> v1:172.21.15.172:6789/0 conn(0x7f14dc157950 legacy=0x7f14dc159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f14e0ad8640 1 -- 172.21.15.130:0/1993520497 >> v1:172.21.15.130:6789/0 conn(0x7f14dc0abe30 legacy=0x7f14dc0aadf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-11T17:18:24.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f14e0ad8640 1 -- 172.21.15.130:0/1993520497 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14dc08cbb0 con 0x7f14dc0ac210 2024-06-11T17:18:24.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f2550ecb640 1 -- 172.21.15.130:0/771799365 wait complete. 2024-06-11T17:18:24.037 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7fd5dcbff640 1 --2- 172.21.15.130:0/1123855205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5d0035100 0x7fd5d00c5860 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd5c800d830 tx=0x7fd5c800dcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:24.037 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7fd5cdffb640 1 -- 172.21.15.130:0/1123855205 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c800b660 con 0x7fd5d0035100 2024-06-11T17:18:24.037 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7fd5de402640 1 -- 172.21.15.130:0/1123855205 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5d00d5080 con 0x7fd5d0035100 2024-06-11T17:18:24.037 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7fd5de402640 1 -- 172.21.15.130:0/1123855205 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5d00d4d50 con 0x7fd5d0035100 2024-06-11T17:18:24.037 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f473959a640 1 -- 172.21.15.130:0/609074980 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472c0ab660 con 0x7f473c0ab870 2024-06-11T17:18:24.037 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7fd5cdffb640 1 -- 172.21.15.130:0/1123855205 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5c8019070 con 0x7fd5d0035100 2024-06-11T17:18:24.038 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.018+0000 7f473959a640 1 -- 172.21.15.130:0/609074980 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f472c0b0070 con 0x7f473c0ab870 2024-06-11T17:18:24.038 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f2550ecb640 1 Processor -- start 2024-06-11T17:18:24.038 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7fd5cdffb640 1 -- 172.21.15.130:0/1123855205 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c800ba00 con 0x7fd5d0035100 2024-06-11T17:18:24.038 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f14e0ad8640 1 --2- 172.21.15.130:0/1993520497 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f14dc0ac210 0x7f14dc157410 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f14cc010be0 tx=0x7f14cc024cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6549f1b21e42abb server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:24.039 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f2550ecb640 1 -- start start 2024-06-11T17:18:24.039 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7fd5de402640 1 -- 172.21.15.130:0/1123855205 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5b8005090 con 0x7fd5d0035100 2024-06-11T17:18:24.039 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f473959a640 1 -- 172.21.15.130:0/609074980 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472c0aba20 con 0x7f473c0ab870 2024-06-11T17:18:24.039 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f473b59e640 1 -- 172.21.15.130:0/609074980 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f473c0ab870 msgr2=0x7f473c073eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f473b59e640 1 --2- 172.21.15.130:0/609074980 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f473c0ab870 0x7f473c073eb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f473c0ad2c0 tx=0x7f472c01c5d0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f9308ff9640 1 -- 172.21.15.130:0/3771360782 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93040b93f0 con 0x7f930c13c490 2024-06-11T17:18:24.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f9308ff9640 1 -- 172.21.15.130:0/3771360782 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93040b95d0 con 0x7f930c13c490 2024-06-11T17:18:24.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f9308ff9640 1 -- 172.21.15.130:0/3771360782 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93040b99c0 con 0x7f930c13c490 2024-06-11T17:18:24.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f4fd9bc6640 1 -- 172.21.15.130:0/808180480 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fb4005090 con 0x7f4fcc0b89f0 2024-06-11T17:18:24.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f2550ecb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f254c0ae9c0 0x7f254c070570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f2550ecb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f254c0b4dc0 0x7f254c06fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f2550ecb640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f254c13c460 0x7f254c073130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f2550ecb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f254c0ae1f0 con 0x7f254c0ae9c0 2024-06-11T17:18:24.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f2550ecb640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f254c0ae070 con 0x7f254c0b4dc0 2024-06-11T17:18:24.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f2550ecb640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f254c0ae370 con 0x7f254c13c460 2024-06-11T17:18:24.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f254a59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f254c0ae9c0 0x7f254c070570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f254a59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f254c0ae9c0 0x7f254c070570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38646/0 (socket says 172.21.15.130:38646) 2024-06-11T17:18:24.042 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f254a59c640 1 -- 172.21.15.130:0/2576645529 learned_addr learned my addr 172.21.15.130:0/2576645529 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:24.042 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f2549d9b640 1 --2- 172.21.15.130:0/2576645529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f254c0b4dc0 0x7f254c06fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.042 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f14d3fff640 1 -- 172.21.15.130:0/1993520497 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14cc0ba070 con 0x7f14dc0ac210 2024-06-11T17:18:24.042 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f9312a5f640 1 -- 172.21.15.130:0/3771360782 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f930c06ed30 con 0x7f930c13c490 2024-06-11T17:18:24.042 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f9312a5f640 1 -- 172.21.15.130:0/3771360782 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f930c13b530 con 0x7f930c13c490 2024-06-11T17:18:24.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f14d3fff640 1 -- 172.21.15.130:0/1993520497 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14cc0adb50 con 0x7f14dc0ac210 2024-06-11T17:18:24.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f14d3fff640 1 -- 172.21.15.130:0/1993520497 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14cc0b5440 con 0x7f14dc0ac210 2024-06-11T17:18:24.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f14e353d640 1 -- 172.21.15.130:0/1993520497 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f14dc0ac210 msgr2=0x7f14dc157410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f14e353d640 1 --2- 172.21.15.130:0/1993520497 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f14dc0ac210 0x7f14dc157410 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f14cc010be0 tx=0x7f14cc024cb0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f14e353d640 1 -- 172.21.15.130:0/1993520497 shutdown_connections 2024-06-11T17:18:24.044 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f14e353d640 1 --2- 172.21.15.130:0/1993520497 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f14dc0ac210 0x7f14dc157410 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.044 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7fd5cdffb640 1 -- 172.21.15.130:0/1123855205 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7fd5c801e460 con 0x7fd5d0035100 2024-06-11T17:18:24.044 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f14e353d640 1 -- 172.21.15.130:0/1993520497 >> 172.21.15.130:0/1993520497 conn(0x7f14dc0b4ab0 msgr2=0x7f14dc0b4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:24.044 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f254a59c640 1 -- 172.21.15.130:0/2576645529 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f254c13c460 msgr2=0x7f254c073130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.045 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f254a59c640 1 --2- 172.21.15.130:0/2576645529 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f254c13c460 0x7f254c073130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.045 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f254a59c640 1 -- 172.21.15.130:0/2576645529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f254c0b4dc0 msgr2=0x7f254c06fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.045 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f254a59c640 1 --2- 172.21.15.130:0/2576645529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f254c0b4dc0 0x7f254c06fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.045 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f254a59c640 1 -- 172.21.15.130:0/2576645529 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f254c0716f0 con 0x7f254c0ae9c0 2024-06-11T17:18:24.045 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7fd5cdffb640 1 --2- 172.21.15.130:0/1123855205 >> v2:172.21.15.130:6816/3863300924 conn(0x7fd5bc070d60 0x7fd5bc073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.045 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7fd5cdffb640 1 -- 172.21.15.130:0/1123855205 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4090+0+0 (secure 0 0 0) 0x7fd5c80918a0 con 0x7fd5d0035100 2024-06-11T17:18:24.045 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f254a59c640 1 --2- 172.21.15.130:0/2576645529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f254c0ae9c0 0x7f254c070570 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f254000d800 tx=0x7f254000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:24.046 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7fd5dd400640 1 --2- 172.21.15.130:0/1123855205 >> v2:172.21.15.130:6816/3863300924 conn(0x7fd5bc070d60 0x7fd5bc073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.046 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f473b59e640 1 -- 172.21.15.130:0/609074980 shutdown_connections 2024-06-11T17:18:24.046 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f473b59e640 1 --2- 172.21.15.130:0/609074980 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f473c0ab870 0x7f473c073eb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.047 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f473b59e640 1 --2- 172.21.15.130:0/609074980 >> v2:172.21.15.172:3300/0 conn(0x7f473c13f730 0x7f473c0ac690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.047 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f473b59e640 1 -- 172.21.15.130:0/609074980 >> 172.21.15.130:0/609074980 conn(0x7f473c0b4ab0 msgr2=0x7f473c0b4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:24.047 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f473b59e640 1 -- 172.21.15.130:0/609074980 shutdown_connections 2024-06-11T17:18:24.047 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7f473b59e640 1 -- 172.21.15.130:0/609074980 wait complete. 2024-06-11T17:18:24.047 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.022+0000 7fd5dd400640 1 --2- 172.21.15.130:0/1123855205 >> v2:172.21.15.130:6816/3863300924 conn(0x7fd5bc070d60 0x7fd5bc073220 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4009870 tx=0x7fd5d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:24.047 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.026+0000 7f9312a5f640 1 -- 172.21.15.130:0/3771360782 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f930c13b730 con 0x7f930c13c490 2024-06-11T17:18:24.048 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.026+0000 7f473b59e640 1 Processor -- start 2024-06-11T17:18:24.048 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.026+0000 7f9308ff9640 1 -- 172.21.15.130:0/3771360782 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f93040c1400 con 0x7f930c13c490 2024-06-11T17:18:24.048 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.026+0000 7f9308ff9640 1 --2- 172.21.15.130:0/3771360782 >> v2:172.21.15.130:6816/3863300924 conn(0x7f92f8070db0 0x7f92f8073270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.048 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.026+0000 7f9308ff9640 1 -- 172.21.15.130:0/3771360782 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 4090+0+0 (secure 0 0 0) 0x7f93040be070 con 0x7f930c13c490 2024-06-11T17:18:24.048 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.026+0000 7f930b7fe640 1 --2- 172.21.15.130:0/3771360782 >> v2:172.21.15.130:6816/3863300924 conn(0x7f92f8070db0 0x7f92f8073270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.049 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.026+0000 7f473b59e640 1 -- start start 2024-06-11T17:18:24.049 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.026+0000 7f473b59e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f473c0ab490 0x7f473c0731e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.049 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.026+0000 7f473b59e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f473c0ab870 0x7f473c1431b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.049 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.026+0000 7f473b59e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f473c13f730 0x7f473c1e50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.049 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.026+0000 7f473b59e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f473c14bfa0 con 0x7f473c0ab870 2024-06-11T17:18:24.049 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.026+0000 7f473b59e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f473c14be20 con 0x7f473c13f730 2024-06-11T17:18:24.049 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.026+0000 7f473b59e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f473c14c120 con 0x7f473c0ab490 2024-06-11T17:18:24.049 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.026+0000 7f930b7fe640 1 --2- 172.21.15.130:0/3771360782 >> v2:172.21.15.130:6816/3863300924 conn(0x7f92f8070db0 0x7f92f8073270 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f930c0b4680 tx=0x7f92fc0079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:24.050 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.026+0000 7f4739d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f473c0ab870 0x7f473c1431b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.050 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.026+0000 7f4739d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f473c0ab870 0x7f473c1431b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38652/0 (socket says 172.21.15.130:38652) 2024-06-11T17:18:24.050 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.026+0000 7f4739d9b640 1 -- 172.21.15.130:0/4182826128 learned_addr learned my addr 172.21.15.130:0/4182826128 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:24.050 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.026+0000 7f4739d9b640 1 -- 172.21.15.130:0/4182826128 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f473c0ab490 msgr2=0x7f473c0731e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.050 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.026+0000 7f4739d9b640 1 --2- 172.21.15.130:0/4182826128 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f473c0ab490 0x7f473c0731e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.050 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.026+0000 7f4739d9b640 1 -- 172.21.15.130:0/4182826128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f473c13f730 msgr2=0x7f473c1e50f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-11T17:18:24.050 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.026+0000 7f4739d9b640 1 --2- 172.21.15.130:0/4182826128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f473c13f730 0x7f473c1e50f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.050 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.026+0000 7f4739d9b640 1 -- 172.21.15.130:0/4182826128 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f473c144f70 con 0x7f473c0ab870 2024-06-11T17:18:24.051 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.026+0000 7f4739d9b640 1 --2- 172.21.15.130:0/4182826128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f473c0ab870 0x7f473c1431b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f473000d990 tx=0x7f473000de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:24.051 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.026+0000 7f14e353d640 1 -- 172.21.15.130:0/1993520497 shutdown_connections 2024-06-11T17:18:24.051 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.030+0000 7f253affd640 1 -- 172.21.15.130:0/2576645529 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254000b640 con 0x7f254c0ae9c0 2024-06-11T17:18:24.051 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.030+0000 7f472affd640 1 -- 172.21.15.130:0/4182826128 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4730015070 con 0x7f473c0ab870 2024-06-11T17:18:24.052 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.030+0000 7f2550ecb640 1 -- 172.21.15.130:0/2576645529 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f254c070110 con 0x7f254c0ae9c0 2024-06-11T17:18:24.052 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.030+0000 7f2550ecb640 1 -- 172.21.15.130:0/2576645529 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f254c073840 con 0x7f254c0ae9c0 2024-06-11T17:18:24.052 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.030+0000 7f4fbffff640 1 -- 172.21.15.130:0/808180480 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7f4fc005c3b0 con 0x7f4fcc0b89f0 2024-06-11T17:18:24.052 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.030+0000 7f473b59e640 1 -- 172.21.15.130:0/4182826128 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f473c1e7b20 con 0x7f473c0ab870 2024-06-11T17:18:24.052 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.030+0000 7f473b59e640 1 -- 172.21.15.130:0/4182826128 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f473c1e5630 con 0x7f473c0ab870 2024-06-11T17:18:24.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.026+0000 7f14e353d640 1 -- 172.21.15.130:0/1993520497 wait complete. 2024-06-11T17:18:24.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.030+0000 7f14e353d640 1 Processor -- start 2024-06-11T17:18:24.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.030+0000 7f14e353d640 1 -- start start 2024-06-11T17:18:24.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.030+0000 7f14e353d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14dc0abe30 0x7f14dc157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.030+0000 7f14e353d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f14dc0ac210 0x7f14dc152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.030+0000 7f14e353d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f14dc157950 0x7f14dc155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.030+0000 7f14e353d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f14dc15de00 con 0x7f14dc157950 2024-06-11T17:18:24.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.030+0000 7f14e353d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f14dc15dc80 con 0x7f14dc0abe30 2024-06-11T17:18:24.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.030+0000 7f14e353d640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f14dc15df80 con 0x7f14dc0ac210 2024-06-11T17:18:24.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.030+0000 7f14e0ad8640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f14dc0ac210 0x7f14dc152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.030+0000 7f14e12d9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14dc0abe30 0x7f14dc157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.054 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.030+0000 7f14e0ad8640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f14dc0ac210 0x7f14dc152bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:53834/0 (socket says 172.21.15.130:53834) 2024-06-11T17:18:24.054 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.030+0000 7f14e0ad8640 1 -- 172.21.15.130:0/4089787773 learned_addr learned my addr 172.21.15.130:0/4089787773 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:24.054 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.030+0000 7f14e1ada640 1 --2- 172.21.15.130:0/4089787773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f14dc157950 0x7f14dc155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.054 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.030+0000 7f14e12d9640 1 -- 172.21.15.130:0/4089787773 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f14dc0ac210 msgr2=0x7f14dc152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.054 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.030+0000 7f14e12d9640 1 --2- 172.21.15.130:0/4089787773 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f14dc0ac210 0x7f14dc152bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.054 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.030+0000 7f14e12d9640 1 -- 172.21.15.130:0/4089787773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f14dc157950 msgr2=0x7f14dc155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.054 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.030+0000 7f14e12d9640 1 --2- 172.21.15.130:0/4089787773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f14dc157950 0x7f14dc155050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.054 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.030+0000 7f14e12d9640 1 -- 172.21.15.130:0/4089787773 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14dc156120 con 0x7f14dc0abe30 2024-06-11T17:18:24.054 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.030+0000 7f14e0ad8640 1 --2- 172.21.15.130:0/4089787773 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f14dc0ac210 0x7f14dc152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-11T17:18:24.054 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.030+0000 7f14e12d9640 1 --2- 172.21.15.130:0/4089787773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14dc0abe30 0x7f14dc157140 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f14d800c410 tx=0x7f14d800c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:24.054 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.030+0000 7f253affd640 1 -- 172.21.15.130:0/2576645529 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2540019070 con 0x7f254c0ae9c0 2024-06-11T17:18:24.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.030+0000 7f253affd640 1 -- 172.21.15.130:0/2576645529 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254000b9e0 con 0x7f254c0ae9c0 2024-06-11T17:18:24.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.030+0000 7f472affd640 1 -- 172.21.15.130:0/4182826128 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4730007a90 con 0x7f473c0ab870 2024-06-11T17:18:24.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.030+0000 7f472affd640 1 -- 172.21.15.130:0/4182826128 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473001f060 con 0x7f473c0ab870 2024-06-11T17:18:24.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.030+0000 7f2550ecb640 1 -- 172.21.15.130:0/2576645529 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f254c0ab600 con 0x7f254c0ae9c0 2024-06-11T17:18:24.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.030+0000 7f473b59e640 1 -- 172.21.15.130:0/4182826128 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4720005090 con 0x7f473c0ab870 2024-06-11T17:18:24.056 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.034+0000 7f253affd640 1 -- 172.21.15.130:0/2576645529 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f254000bb80 con 0x7f254c0ae9c0 2024-06-11T17:18:24.056 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.034+0000 7f253affd640 1 --2- 172.21.15.130:0/2576645529 >> v2:172.21.15.130:6816/3863300924 conn(0x7f252c070d60 0x7f252c073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.056 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.034+0000 7f253affd640 1 -- 172.21.15.130:0/2576645529 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4090+0+0 (secure 0 0 0) 0x7f2540091840 con 0x7f254c0ae9c0 2024-06-11T17:18:24.056 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.034+0000 7f14d1ffb640 1 -- 172.21.15.130:0/4089787773 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d8011790 con 0x7f14dc0abe30 2024-06-11T17:18:24.057 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.034+0000 7f14e353d640 1 -- 172.21.15.130:0/4089787773 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14dc156400 con 0x7f14dc0abe30 2024-06-11T17:18:24.057 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.034+0000 7f14e353d640 1 -- 172.21.15.130:0/4089787773 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14dc1569c0 con 0x7f14dc0abe30 2024-06-11T17:18:24.057 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.034+0000 7f14d1ffb640 1 -- 172.21.15.130:0/4089787773 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14d8017070 con 0x7f14dc0abe30 2024-06-11T17:18:24.057 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.034+0000 7f14d1ffb640 1 -- 172.21.15.130:0/4089787773 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d8011b50 con 0x7f14dc0abe30 2024-06-11T17:18:24.057 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.034+0000 7f14e353d640 1 -- 172.21.15.130:0/4089787773 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14bc005090 con 0x7f14dc0abe30 2024-06-11T17:18:24.057 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.034+0000 7f472affd640 1 -- 172.21.15.130:0/4182826128 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f4730018070 con 0x7f473c0ab870 2024-06-11T17:18:24.057 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.034+0000 7f2549d9b640 1 --2- 172.21.15.130:0/2576645529 >> v2:172.21.15.130:6816/3863300924 conn(0x7f252c070d60 0x7f252c073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.057 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.034+0000 7f2549d9b640 1 --2- 172.21.15.130:0/2576645529 >> v2:172.21.15.130:6816/3863300924 conn(0x7f252c070d60 0x7f252c073220 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f25440ae000 tx=0x7f25440a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:24.058 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.034+0000 7fd5cdffb640 1 -- 172.21.15.130:0/1123855205 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7fd5c805e260 con 0x7fd5d0035100 2024-06-11T17:18:24.058 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.038+0000 7f472affd640 1 --2- 172.21.15.130:0/4182826128 >> v2:172.21.15.130:6816/3863300924 conn(0x7f471c070d60 0x7f471c073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.058 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.038+0000 7f472affd640 1 -- 172.21.15.130:0/4182826128 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4090+0+0 (secure 0 0 0) 0x7f4730090f10 con 0x7f473c0ab870 2024-06-11T17:18:24.058 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.038+0000 7f473a59c640 1 --2- 172.21.15.130:0/4182826128 >> v2:172.21.15.130:6816/3863300924 conn(0x7f471c070d60 0x7f471c073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.059 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.038+0000 7f473a59c640 1 --2- 172.21.15.130:0/4182826128 >> v2:172.21.15.130:6816/3863300924 conn(0x7f471c070d60 0x7f471c073220 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4734001ee0 tx=0x7f4734007d10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:24.059 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.038+0000 7f14d1ffb640 1 -- 172.21.15.130:0/4089787773 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f14d8011cf0 con 0x7f14dc0abe30 2024-06-11T17:18:24.059 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.038+0000 7f14d1ffb640 1 --2- 172.21.15.130:0/4089787773 >> v2:172.21.15.130:6816/3863300924 conn(0x7f14c0070d60 0x7f14c0073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.059 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.038+0000 7f14d1ffb640 1 -- 172.21.15.130:0/4089787773 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4090+0+0 (secure 0 0 0) 0x7f14d80911e0 con 0x7f14dc0abe30 2024-06-11T17:18:24.059 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.038+0000 7f14e0ad8640 1 --2- 172.21.15.130:0/4089787773 >> v2:172.21.15.130:6816/3863300924 conn(0x7f14c0070d60 0x7f14c0073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.059 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.038+0000 7f14e0ad8640 1 --2- 172.21.15.130:0/4089787773 >> v2:172.21.15.130:6816/3863300924 conn(0x7f14c0070d60 0x7f14c0073220 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f14dc157680 tx=0x7f14cc012040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:24.060 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.038+0000 7f9308ff9640 1 -- 172.21.15.130:0/3771360782 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7f930c13b730 con 0x7f930c13c490 2024-06-11T17:18:24.060 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.046+0000 7f253affd640 1 -- 172.21.15.130:0/2576645529 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7f254005e220 con 0x7f254c0ae9c0 2024-06-11T17:18:24.060 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.050+0000 7f14d1ffb640 1 -- 172.21.15.130:0/4089787773 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7f14d805dba0 con 0x7f14dc0abe30 2024-06-11T17:18:24.060 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.054+0000 7f472affd640 1 -- 172.21.15.130:0/4182826128 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7f473005d8f0 con 0x7f473c0ab870 2024-06-11T17:18:24.254 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.254+0000 7fc81025e640 1 -- 172.21.15.130:0/1538131377 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fc7ec005380 con 0x7fc80813c310 2024-06-11T17:18:24.255 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.254+0000 7fc7fe7fc640 1 -- 172.21.15.130:0/1538131377 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc800060870 con 0x7fc80813c310 2024-06-11T17:18:24.258 INFO:teuthology.orchestra.run.smithi130.stdout:60129542147 2024-06-11T17:18:24.259 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.258+0000 7fc81025e640 1 -- 172.21.15.130:0/1538131377 >> v2:172.21.15.130:6816/3863300924 conn(0x7fc7f4070f70 msgr2=0x7fc7f4073430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.259 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.258+0000 7fc81025e640 1 --2- 172.21.15.130:0/1538131377 >> v2:172.21.15.130:6816/3863300924 conn(0x7fc7f4070f70 0x7fc7f4073430 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc804001ec0 tx=0x7fc804009040 comp rx=0 tx=0).stop 2024-06-11T17:18:24.259 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.262+0000 7fc81025e640 1 -- 172.21.15.130:0/1538131377 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc80813c310 msgr2=0x7fc80813ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.259 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.262+0000 7fc81025e640 1 --2- 172.21.15.130:0/1538131377 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc80813c310 0x7fc80813ebe0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc80000caa0 tx=0x7fc80000cea0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.267 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.270+0000 7fc81025e640 1 -- 172.21.15.130:0/1538131377 shutdown_connections 2024-06-11T17:18:24.267 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.270+0000 7fc81025e640 1 --2- 172.21.15.130:0/1538131377 >> v2:172.21.15.130:6816/3863300924 conn(0x7fc7f4070f70 0x7fc7f4073430 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.267 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.270+0000 7fc81025e640 1 --2- 172.21.15.130:0/1538131377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc808131620 0x7fc808136380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.268 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.270+0000 7fc81025e640 1 --2- 172.21.15.130:0/1538131377 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc80813c310 0x7fc80813ebe0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.268 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.270+0000 7fc81025e640 1 --2- 172.21.15.130:0/1538131377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8080ac530 0x7fc80813cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.268 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.270+0000 7fc81025e640 1 -- 172.21.15.130:0/1538131377 >> 172.21.15.130:0/1538131377 conn(0x7fc8080b4ab0 msgr2=0x7fc808135040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:24.268 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.270+0000 7fc81025e640 1 -- 172.21.15.130:0/1538131377 shutdown_connections 2024-06-11T17:18:24.268 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.270+0000 7fc81025e640 1 -- 172.21.15.130:0/1538131377 wait complete. 2024-06-11T17:18:24.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.4 2024-06-11T17:18:24.290 DEBUG:teuthology.parallel:result is None 2024-06-11T17:18:24.300 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.302+0000 7f34e58ee640 1 -- 172.21.15.130:0/2878269795 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f34c0005380 con 0x7f34e006fff0 2024-06-11T17:18:24.301 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.302+0000 7f34c7fff640 1 -- 172.21.15.130:0/2878269795 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f34d405d1d0 con 0x7f34e006fff0 2024-06-11T17:18:24.301 INFO:teuthology.orchestra.run.smithi130.stdout:60129542147 2024-06-11T17:18:24.305 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.306+0000 7f34e58ee640 1 -- 172.21.15.130:0/2878269795 >> v2:172.21.15.130:6816/3863300924 conn(0x7f34cc070e60 msgr2=0x7f34cc073320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.305 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.306+0000 7f34e58ee640 1 --2- 172.21.15.130:0/2878269795 >> v2:172.21.15.130:6816/3863300924 conn(0x7f34cc070e60 0x7f34cc073320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f34d80b0000 tx=0x7f34d80a9000 comp rx=0 tx=0).stop 2024-06-11T17:18:24.305 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.306+0000 7f34e58ee640 1 -- 172.21.15.130:0/2878269795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34e006fff0 msgr2=0x7f34e01e8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.305 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.306+0000 7f34e58ee640 1 --2- 172.21.15.130:0/2878269795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34e006fff0 0x7f34e01e8080 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f34d400b410 tx=0x7f34d400b8d0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.306 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.306+0000 7f34e58ee640 1 -- 172.21.15.130:0/2878269795 shutdown_connections 2024-06-11T17:18:24.306 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.306+0000 7f34e58ee640 1 --2- 172.21.15.130:0/2878269795 >> v2:172.21.15.130:6816/3863300924 conn(0x7f34cc070e60 0x7f34cc073320 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.306 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.306+0000 7f34e58ee640 1 --2- 172.21.15.130:0/2878269795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34e006fff0 0x7f34e01e8080 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.306 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.306+0000 7f34e58ee640 1 --2- 172.21.15.130:0/2878269795 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34e00adfa0 0x7f34e01e7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.306 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.306+0000 7f34e58ee640 1 --2- 172.21.15.130:0/2878269795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34e00ac530 0x7f34e01421b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.306 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.306+0000 7f34e58ee640 1 -- 172.21.15.130:0/2878269795 >> 172.21.15.130:0/2878269795 conn(0x7f34e00b4ab0 msgr2=0x7f34e00b3880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:24.306 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.306+0000 7f34e58ee640 1 -- 172.21.15.130:0/2878269795 shutdown_connections 2024-06-11T17:18:24.306 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.306+0000 7f34e58ee640 1 -- 172.21.15.130:0/2878269795 wait complete. 2024-06-11T17:18:24.318 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.318+0000 7f4fd9bc6640 1 -- 172.21.15.130:0/808180480 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f4fb4005380 con 0x7f4fcc0b89f0 2024-06-11T17:18:24.319 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.322+0000 7f4fbffff640 1 -- 172.21.15.130:0/808180480 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4fc00606b0 con 0x7f4fcc0b89f0 2024-06-11T17:18:24.319 INFO:teuthology.orchestra.run.smithi130.stdout:60129542148 2024-06-11T17:18:24.323 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.322+0000 7f4fd9bc6640 1 -- 172.21.15.130:0/808180480 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4fb8070e30 msgr2=0x7f4fb80732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.323 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.322+0000 7f4fd9bc6640 1 --2- 172.21.15.130:0/808180480 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4fb8070e30 0x7f4fb80732f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4fd407b660 tx=0x7f4fd4068e50 comp rx=0 tx=0).stop 2024-06-11T17:18:24.323 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.322+0000 7f4fd9bc6640 1 -- 172.21.15.130:0/808180480 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fcc0b89f0 msgr2=0x7f4fcc0b8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.323 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.322+0000 7f4fd9bc6640 1 --2- 172.21.15.130:0/808180480 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fcc0b89f0 0x7f4fcc0b8e70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4fc000e600 tx=0x7f4fc000eac0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.323 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.326+0000 7f4fd9bc6640 1 -- 172.21.15.130:0/808180480 shutdown_connections 2024-06-11T17:18:24.324 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.326+0000 7f4fd9bc6640 1 --2- 172.21.15.130:0/808180480 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4fb8070e30 0x7f4fb80732f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.324 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.326+0000 7f4fd9bc6640 1 --2- 172.21.15.130:0/808180480 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fcc0b89f0 0x7f4fcc0b8e70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.324 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.326+0000 7f4fd9bc6640 1 --2- 172.21.15.130:0/808180480 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4fcc0344a0 0x7f4fcc0b9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.324 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.326+0000 7f4fd9bc6640 1 --2- 172.21.15.130:0/808180480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fcc02aed0 0x7f4fcc0b9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.324 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.326+0000 7f4fd9bc6640 1 -- 172.21.15.130:0/808180480 >> 172.21.15.130:0/808180480 conn(0x7f4fcc005a10 msgr2=0x7f4fcc033d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:24.324 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.326+0000 7f4fd9bc6640 1 -- 172.21.15.130:0/808180480 shutdown_connections 2024-06-11T17:18:24.324 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.326+0000 7f4fd9bc6640 1 -- 172.21.15.130:0/808180480 wait complete. 2024-06-11T17:18:24.325 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.7 2024-06-11T17:18:24.326 DEBUG:teuthology.parallel:result is None 2024-06-11T17:18:24.340 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.2 2024-06-11T17:18:24.340 DEBUG:teuthology.parallel:result is None 2024-06-11T17:18:24.344 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.346+0000 7f473b59e640 1 -- 172.21.15.130:0/4182826128 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f4720005650 con 0x7f473c0ab870 2024-06-11T17:18:24.345 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.346+0000 7f472affd640 1 -- 172.21.15.130:0/4182826128 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f473005d1f0 con 0x7f473c0ab870 2024-06-11T17:18:24.345 INFO:teuthology.orchestra.run.smithi130.stdout:55834574851 2024-06-11T17:18:24.347 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.350+0000 7f473b59e640 1 -- 172.21.15.130:0/4182826128 >> v2:172.21.15.130:6816/3863300924 conn(0x7f471c070d60 msgr2=0x7f471c073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.347 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.350+0000 7f473b59e640 1 --2- 172.21.15.130:0/4182826128 >> v2:172.21.15.130:6816/3863300924 conn(0x7f471c070d60 0x7f471c073220 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4734001ee0 tx=0x7f4734007d10 comp rx=0 tx=0).stop 2024-06-11T17:18:24.347 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.350+0000 7f473b59e640 1 -- 172.21.15.130:0/4182826128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f473c0ab870 msgr2=0x7f473c1431b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.347 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.350+0000 7f473b59e640 1 --2- 172.21.15.130:0/4182826128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f473c0ab870 0x7f473c1431b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f473000d990 tx=0x7f473000de50 comp rx=0 tx=0).stop 2024-06-11T17:18:24.347 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.350+0000 7f473b59e640 1 -- 172.21.15.130:0/4182826128 shutdown_connections 2024-06-11T17:18:24.348 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.350+0000 7f473b59e640 1 --2- 172.21.15.130:0/4182826128 >> v2:172.21.15.130:6816/3863300924 conn(0x7f471c070d60 0x7f471c073220 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.348 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.350+0000 7f473b59e640 1 --2- 172.21.15.130:0/4182826128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f473c13f730 0x7f473c1e50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.348 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.350+0000 7f473b59e640 1 --2- 172.21.15.130:0/4182826128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f473c0ab870 0x7f473c1431b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.348 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.350+0000 7f473b59e640 1 --2- 172.21.15.130:0/4182826128 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f473c0ab490 0x7f473c0731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.348 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.350+0000 7f473b59e640 1 -- 172.21.15.130:0/4182826128 >> 172.21.15.130:0/4182826128 conn(0x7f473c0b4ab0 msgr2=0x7f473c0ae540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:24.348 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.350+0000 7f473b59e640 1 -- 172.21.15.130:0/4182826128 shutdown_connections 2024-06-11T17:18:24.348 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.350+0000 7f473b59e640 1 -- 172.21.15.130:0/4182826128 wait complete. 2024-06-11T17:18:24.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.6 2024-06-11T17:18:24.362 DEBUG:teuthology.parallel:result is None 2024-06-11T17:18:24.369 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.370+0000 7fd5de402640 1 -- 172.21.15.130:0/1123855205 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fd5b8005650 con 0x7fd5d0035100 2024-06-11T17:18:24.370 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.370+0000 7fd5cdffb640 1 -- 172.21.15.130:0/1123855205 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd5c805db60 con 0x7fd5d0035100 2024-06-11T17:18:24.370 INFO:teuthology.orchestra.run.smithi130.stdout:60129542149 2024-06-11T17:18:24.373 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.374+0000 7f9312a5f640 1 -- 172.21.15.130:0/3771360782 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f930c0ab100 con 0x7f930c13c490 2024-06-11T17:18:24.374 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.374+0000 7fd5de402640 1 -- 172.21.15.130:0/1123855205 >> v2:172.21.15.130:6816/3863300924 conn(0x7fd5bc070d60 msgr2=0x7fd5bc073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.374 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.374+0000 7fd5de402640 1 --2- 172.21.15.130:0/1123855205 >> v2:172.21.15.130:6816/3863300924 conn(0x7fd5bc070d60 0x7fd5bc073220 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4009870 tx=0x7fd5d4008040 comp rx=0 tx=0).stop 2024-06-11T17:18:24.374 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.374+0000 7fd5de402640 1 -- 172.21.15.130:0/1123855205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5d0035100 msgr2=0x7fd5d00c5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.374 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.374+0000 7fd5de402640 1 --2- 172.21.15.130:0/1123855205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5d0035100 0x7fd5d00c5860 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd5c800d830 tx=0x7fd5c800dcf0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.374 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.374+0000 7fd5de402640 1 -- 172.21.15.130:0/1123855205 shutdown_connections 2024-06-11T17:18:24.375 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.374+0000 7fd5de402640 1 --2- 172.21.15.130:0/1123855205 >> v2:172.21.15.130:6816/3863300924 conn(0x7fd5bc070d60 0x7fd5bc073220 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.375 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.374+0000 7fd5de402640 1 --2- 172.21.15.130:0/1123855205 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5d00c5da0 0x7fd5d0164320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.375 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.374+0000 7fd5de402640 1 --2- 172.21.15.130:0/1123855205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5d0035100 0x7fd5d00c5860 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.375 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.374+0000 7fd5de402640 1 --2- 172.21.15.130:0/1123855205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd5d0009510 0x7fd5d00d3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.375 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.374+0000 7fd5de402640 1 -- 172.21.15.130:0/1123855205 >> 172.21.15.130:0/1123855205 conn(0x7fd5d0005d80 msgr2=0x7fd5d0036fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:24.376 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.374+0000 7f9308ff9640 1 -- 172.21.15.130:0/3771360782 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9304018830 con 0x7f930c13c490 2024-06-11T17:18:24.376 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.374+0000 7fd5de402640 1 -- 172.21.15.130:0/1123855205 shutdown_connections 2024-06-11T17:18:24.376 INFO:teuthology.orchestra.run.smithi130.stdout:55834574850 2024-06-11T17:18:24.377 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.374+0000 7fd5de402640 1 -- 172.21.15.130:0/1123855205 wait complete. 2024-06-11T17:18:24.377 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.378+0000 7f2550ecb640 1 -- 172.21.15.130:0/2576645529 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f254c141030 con 0x7f254c0ae9c0 2024-06-11T17:18:24.377 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.378+0000 7f253affd640 1 -- 172.21.15.130:0/2576645529 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f254005db20 con 0x7f254c0ae9c0 2024-06-11T17:18:24.377 INFO:teuthology.orchestra.run.smithi130.stdout:55834574852 2024-06-11T17:18:24.379 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.378+0000 7f9312a5f640 1 -- 172.21.15.130:0/3771360782 >> v2:172.21.15.130:6816/3863300924 conn(0x7f92f8070db0 msgr2=0x7f92f8073270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.379 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.378+0000 7f9312a5f640 1 --2- 172.21.15.130:0/3771360782 >> v2:172.21.15.130:6816/3863300924 conn(0x7f92f8070db0 0x7f92f8073270 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f930c0b4680 tx=0x7f92fc0079c0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.379 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.378+0000 7f9312a5f640 1 -- 172.21.15.130:0/3771360782 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f930c13c490 msgr2=0x7f930c0b3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.379 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.378+0000 7f9312a5f640 1 --2- 172.21.15.130:0/3771360782 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f930c13c490 0x7f930c0b3390 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f930c06db70 tx=0x7f930401b9e0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.379 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.378+0000 7f9312a5f640 1 -- 172.21.15.130:0/3771360782 shutdown_connections 2024-06-11T17:18:24.379 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.378+0000 7f9312a5f640 1 --2- 172.21.15.130:0/3771360782 >> v2:172.21.15.130:6816/3863300924 conn(0x7f92f8070db0 0x7f92f8073270 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.379 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.378+0000 7f9312a5f640 1 --2- 172.21.15.130:0/3771360782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f930c06f430 0x7f930c135620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.380 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.378+0000 7f9312a5f640 1 --2- 172.21.15.130:0/3771360782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f930c143020 0x7f930c13ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.380 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.378+0000 7f9312a5f640 1 --2- 172.21.15.130:0/3771360782 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f930c13c490 0x7f930c0b3390 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.380 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.378+0000 7f9312a5f640 1 -- 172.21.15.130:0/3771360782 >> 172.21.15.130:0/3771360782 conn(0x7f930c0b46b0 msgr2=0x7f930c0b4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:24.380 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.378+0000 7f9312a5f640 1 -- 172.21.15.130:0/3771360782 shutdown_connections 2024-06-11T17:18:24.380 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.378+0000 7f9312a5f640 1 -- 172.21.15.130:0/3771360782 wait complete. 2024-06-11T17:18:24.381 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.382+0000 7f2550ecb640 1 -- 172.21.15.130:0/2576645529 >> v2:172.21.15.130:6816/3863300924 conn(0x7f252c070d60 msgr2=0x7f252c073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.381 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.382+0000 7f2550ecb640 1 --2- 172.21.15.130:0/2576645529 >> v2:172.21.15.130:6816/3863300924 conn(0x7f252c070d60 0x7f252c073220 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f25440ae000 tx=0x7f25440a7070 comp rx=0 tx=0).stop 2024-06-11T17:18:24.381 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.382+0000 7f2550ecb640 1 -- 172.21.15.130:0/2576645529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f254c0ae9c0 msgr2=0x7f254c070570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.381 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.382+0000 7f2550ecb640 1 --2- 172.21.15.130:0/2576645529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f254c0ae9c0 0x7f254c070570 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f254000d800 tx=0x7f254000dcc0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.381 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.382+0000 7f2550ecb640 1 -- 172.21.15.130:0/2576645529 shutdown_connections 2024-06-11T17:18:24.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.382+0000 7f2550ecb640 1 --2- 172.21.15.130:0/2576645529 >> v2:172.21.15.130:6816/3863300924 conn(0x7f252c070d60 0x7f252c073220 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.382+0000 7f2550ecb640 1 --2- 172.21.15.130:0/2576645529 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f254c13c460 0x7f254c073130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.382+0000 7f2550ecb640 1 --2- 172.21.15.130:0/2576645529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f254c0b4dc0 0x7f254c06fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.382+0000 7f2550ecb640 1 --2- 172.21.15.130:0/2576645529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f254c0ae9c0 0x7f254c070570 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.382+0000 7f2550ecb640 1 -- 172.21.15.130:0/2576645529 >> 172.21.15.130:0/2576645529 conn(0x7f254c06c9d0 msgr2=0x7f254c139ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:24.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.382+0000 7f2550ecb640 1 -- 172.21.15.130:0/2576645529 shutdown_connections 2024-06-11T17:18:24.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.382+0000 7f2550ecb640 1 -- 172.21.15.130:0/2576645529 wait complete. 2024-06-11T17:18:24.386 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.386+0000 7f14e353d640 1 -- 172.21.15.130:0/4089787773 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f14bc005650 con 0x7f14dc0abe30 2024-06-11T17:18:24.387 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.386+0000 7f14d1ffb640 1 -- 172.21.15.130:0/4089787773 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f14d805d4a0 con 0x7f14dc0abe30 2024-06-11T17:18:24.387 INFO:teuthology.orchestra.run.smithi130.stdout:60129542148 2024-06-11T17:18:24.389 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.390+0000 7f14e353d640 1 -- 172.21.15.130:0/4089787773 >> v2:172.21.15.130:6816/3863300924 conn(0x7f14c0070d60 msgr2=0x7f14c0073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.389 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.390+0000 7f14e353d640 1 --2- 172.21.15.130:0/4089787773 >> v2:172.21.15.130:6816/3863300924 conn(0x7f14c0070d60 0x7f14c0073220 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f14dc157680 tx=0x7f14cc012040 comp rx=0 tx=0).stop 2024-06-11T17:18:24.389 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.390+0000 7f14e353d640 1 -- 172.21.15.130:0/4089787773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14dc0abe30 msgr2=0x7f14dc157140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.390+0000 7f14e353d640 1 --2- 172.21.15.130:0/4089787773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14dc0abe30 0x7f14dc157140 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f14d800c410 tx=0x7f14d800c8d0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.390+0000 7f14e353d640 1 -- 172.21.15.130:0/4089787773 shutdown_connections 2024-06-11T17:18:24.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.390+0000 7f14e353d640 1 --2- 172.21.15.130:0/4089787773 >> v2:172.21.15.130:6816/3863300924 conn(0x7f14c0070d60 0x7f14c0073220 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.390+0000 7f14e353d640 1 --2- 172.21.15.130:0/4089787773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f14dc157950 0x7f14dc155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.390+0000 7f14e353d640 1 --2- 172.21.15.130:0/4089787773 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f14dc0ac210 0x7f14dc152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.390+0000 7f14e353d640 1 --2- 172.21.15.130:0/4089787773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14dc0abe30 0x7f14dc157140 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.390+0000 7f14e353d640 1 -- 172.21.15.130:0/4089787773 >> 172.21.15.130:0/4089787773 conn(0x7f14dc0b4ab0 msgr2=0x7f14dc0af9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:24.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.390+0000 7f14e353d640 1 -- 172.21.15.130:0/4089787773 shutdown_connections 2024-06-11T17:18:24.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.390+0000 7f14e353d640 1 -- 172.21.15.130:0/4089787773 wait complete. 2024-06-11T17:18:24.398 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.5 2024-06-11T17:18:24.399 DEBUG:teuthology.parallel:result is None 2024-06-11T17:18:24.399 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574850 for osd.3 2024-06-11T17:18:24.399 DEBUG:teuthology.parallel:result is None 2024-06-11T17:18:24.402 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.1 2024-06-11T17:18:24.402 DEBUG:teuthology.parallel:result is None 2024-06-11T17:18:24.408 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.0 2024-06-11T17:18:24.408 DEBUG:teuthology.parallel:result is None 2024-06-11T17:18:24.408 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-11T17:18:24.408 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-11T17:18:24.554 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.554+0000 7f044d5b3640 1 Processor -- start 2024-06-11T17:18:24.554 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.554+0000 7f044d5b3640 1 -- start start 2024-06-11T17:18:24.555 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.554+0000 7f044d5b3640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f04480701a0 0x7f044813cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.555 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.554+0000 7f044d5b3640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f04480af5f0 0x7f044813d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.555 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.554+0000 7f044d5b3640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0448072490 con 0x7f04480707e0 2024-06-11T17:18:24.555 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.554+0000 7f044d5b3640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f0448070580 con 0x7f04480701a0 2024-06-11T17:18:24.556 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.554+0000 7f044d5b3640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f0448072840 con 0x7f04480af5f0 2024-06-11T17:18:24.556 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.558+0000 7f0446ffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f04480701a0 0x7f044813cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.556 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.558+0000 7f0446ffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f04480701a0 0x7f044813cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38676/0 (socket says 172.21.15.130:38676) 2024-06-11T17:18:24.556 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.558+0000 7f0446ffd640 1 -- 172.21.15.130:0/2543414387 learned_addr learned my addr 172.21.15.130:0/2543414387 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:24.556 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.558+0000 7f043ffff640 1 --2- 172.21.15.130:0/2543414387 >> v2:172.21.15.172:3300/0 conn(0x7f04480af5f0 0x7f044813d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.556 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.558+0000 7f0446ffd640 1 -- 172.21.15.130:0/2543414387 >> v2:172.21.15.172:3300/0 conn(0x7f04480af5f0 msgr2=0x7f044813d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:24.556 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.558+0000 7f0446ffd640 1 --2- 172.21.15.130:0/2543414387 >> v2:172.21.15.172:3300/0 conn(0x7f04480af5f0 0x7f044813d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.556 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.558+0000 7f0446ffd640 1 -- 172.21.15.130:0/2543414387 >> v1:172.21.15.172:6789/0 conn(0x7f04480707e0 legacy=0x7f0448070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:24.556 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.558+0000 7f0446ffd640 1 -- 172.21.15.130:0/2543414387 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0448071320 con 0x7f04480701a0 2024-06-11T17:18:24.556 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.558+0000 7f043ffff640 1 --2- 172.21.15.130:0/2543414387 >> v2:172.21.15.172:3300/0 conn(0x7f04480af5f0 0x7f044813d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-11T17:18:24.558 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.558+0000 7f0446ffd640 1 --2- 172.21.15.130:0/2543414387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04480701a0 0x7f044813cc90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f044806fb10 tx=0x7f043801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108c6ebc254288f8 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:24.558 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.558+0000 7f04467fc640 1 -- 172.21.15.130:0/2543414387 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04380aa620 con 0x7f04480701a0 2024-06-11T17:18:24.558 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.558+0000 7f04467fc640 1 -- 172.21.15.130:0/2543414387 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04380af070 con 0x7f04480701a0 2024-06-11T17:18:24.558 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.558+0000 7f04467fc640 1 -- 172.21.15.130:0/2543414387 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04380aa9e0 con 0x7f04480701a0 2024-06-11T17:18:24.559 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.558+0000 7f044d5b3640 1 -- 172.21.15.130:0/2543414387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04480701a0 msgr2=0x7f044813cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.559 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.558+0000 7f044d5b3640 1 --2- 172.21.15.130:0/2543414387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04480701a0 0x7f044813cc90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f044806fb10 tx=0x7f043801c500 comp rx=0 tx=0).stop 2024-06-11T17:18:24.559 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.558+0000 7f044d5b3640 1 -- 172.21.15.130:0/2543414387 shutdown_connections 2024-06-11T17:18:24.559 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.558+0000 7f044d5b3640 1 --2- 172.21.15.130:0/2543414387 >> v2:172.21.15.172:3300/0 conn(0x7f04480af5f0 0x7f044813d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.559 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.558+0000 7f044d5b3640 1 --2- 172.21.15.130:0/2543414387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04480701a0 0x7f044813cc90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.559 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.558+0000 7f044d5b3640 1 -- 172.21.15.130:0/2543414387 >> 172.21.15.130:0/2543414387 conn(0x7f044806d910 msgr2=0x7f04480b5840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:24.559 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.558+0000 7f044d5b3640 1 -- 172.21.15.130:0/2543414387 shutdown_connections 2024-06-11T17:18:24.559 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.558+0000 7f044d5b3640 1 -- 172.21.15.130:0/2543414387 wait complete. 2024-06-11T17:18:24.560 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.562+0000 7f044d5b3640 1 Processor -- start 2024-06-11T17:18:24.560 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.562+0000 7f044d5b3640 1 -- start start 2024-06-11T17:18:24.561 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.562+0000 7f044d5b3640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f04480701a0 0x7f044806c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.562 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.562+0000 7f044d5b3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04480707e0 0x7f0448143940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.562 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.562+0000 7f044d5b3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04480af5f0 0x7f04480ac690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.562 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.562+0000 7f044d5b3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f044814cbb0 con 0x7f04480af5f0 2024-06-11T17:18:24.562 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.562+0000 7f044d5b3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f044814ca30 con 0x7f04480707e0 2024-06-11T17:18:24.562 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.562+0000 7f044d5b3640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f044814cd30 con 0x7f04480701a0 2024-06-11T17:18:24.562 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.562+0000 7f0446ffd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f04480701a0 0x7f044806c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.562 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.562+0000 7f04477fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04480af5f0 0x7f04480ac690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.562 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.562+0000 7f0446ffd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f04480701a0 0x7f044806c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:53838/0 (socket says 172.21.15.130:53838) 2024-06-11T17:18:24.562 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.562+0000 7f0446ffd640 1 -- 172.21.15.130:0/1832678197 learned_addr learned my addr 172.21.15.130:0/1832678197 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:24.562 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.562+0000 7f043ffff640 1 --2- 172.21.15.130:0/1832678197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04480707e0 0x7f0448143940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.562 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.562+0000 7f04477fe640 1 -- 172.21.15.130:0/1832678197 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f04480701a0 msgr2=0x7f044806c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.562 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.562+0000 7f04477fe640 1 --2- 172.21.15.130:0/1832678197 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f04480701a0 0x7f044806c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.563 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.562+0000 7f04477fe640 1 -- 172.21.15.130:0/1832678197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04480707e0 msgr2=0x7f0448143940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.563 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.562+0000 7f04477fe640 1 --2- 172.21.15.130:0/1832678197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04480707e0 0x7f0448143940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.563 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.562+0000 7f04477fe640 1 -- 172.21.15.130:0/1832678197 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04480aeb70 con 0x7f04480af5f0 2024-06-11T17:18:24.563 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.562+0000 7f043ffff640 1 --2- 172.21.15.130:0/1832678197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04480707e0 0x7f0448143940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-11T17:18:24.563 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.562+0000 7f04477fe640 1 --2- 172.21.15.130:0/1832678197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04480af5f0 0x7f04480ac690 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f044000c780 tx=0x7f044000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:24.563 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.562+0000 7f043f7fe640 1 -- 172.21.15.130:0/1832678197 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0440016020 con 0x7f04480af5f0 2024-06-11T17:18:24.563 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.562+0000 7f043f7fe640 1 -- 172.21.15.130:0/1832678197 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f044000aa50 con 0x7f04480af5f0 2024-06-11T17:18:24.563 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.562+0000 7f044d5b3640 1 -- 172.21.15.130:0/1832678197 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04480af310 con 0x7f04480af5f0 2024-06-11T17:18:24.563 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.562+0000 7f043f7fe640 1 -- 172.21.15.130:0/1832678197 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044000ce30 con 0x7f04480af5f0 2024-06-11T17:18:24.563 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.562+0000 7f044d5b3640 1 -- 172.21.15.130:0/1832678197 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04480ae750 con 0x7f04480af5f0 2024-06-11T17:18:24.564 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.562+0000 7f044d5b3640 1 -- 172.21.15.130:0/1832678197 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0448070c10 con 0x7f04480af5f0 2024-06-11T17:18:24.564 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.566+0000 7f043f7fe640 1 -- 172.21.15.130:0/1832678197 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f0440019020 con 0x7f04480af5f0 2024-06-11T17:18:24.564 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.566+0000 7f043f7fe640 1 --2- 172.21.15.130:0/1832678197 >> v2:172.21.15.130:6816/3863300924 conn(0x7f0428070d60 0x7f0428073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.564 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.566+0000 7f0446ffd640 1 --2- 172.21.15.130:0/1832678197 >> v2:172.21.15.130:6816/3863300924 conn(0x7f0428070d60 0x7f0428073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.565 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.566+0000 7f043f7fe640 1 -- 172.21.15.130:0/1832678197 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4090+0+0 (secure 0 0 0) 0x7f0440090b10 con 0x7f04480af5f0 2024-06-11T17:18:24.565 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.566+0000 7f0446ffd640 1 --2- 172.21.15.130:0/1832678197 >> v2:172.21.15.130:6816/3863300924 conn(0x7f0428070d60 0x7f0428073220 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f043801c540 tx=0x7f04380a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:24.567 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.570+0000 7f043f7fe640 1 -- 172.21.15.130:0/1832678197 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7f0440020020 con 0x7f04480af5f0 2024-06-11T17:18:24.717 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.718+0000 7f044d5b3640 1 -- 172.21.15.130:0/1832678197 --> v2:172.21.15.130:6816/3863300924 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f04480b5040 con 0x7f0428070d60 2024-06-11T17:18:24.717 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.718+0000 7f043f7fe640 1 -- 172.21.15.130:0/1832678197 <== mgr.4107 v2:172.21.15.130:6816/3863300924 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+35516 (secure 0 0 0) 0x7f04480b5040 con 0x7f0428070d60 2024-06-11T17:18:24.718 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:18:24.718 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2024-06-11T17:18:24.720 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.722+0000 7f044d5b3640 1 -- 172.21.15.130:0/1832678197 >> v2:172.21.15.130:6816/3863300924 conn(0x7f0428070d60 msgr2=0x7f0428073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.720 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.722+0000 7f044d5b3640 1 --2- 172.21.15.130:0/1832678197 >> v2:172.21.15.130:6816/3863300924 conn(0x7f0428070d60 0x7f0428073220 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f043801c540 tx=0x7f04380a7000 comp rx=0 tx=0).stop 2024-06-11T17:18:24.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.722+0000 7f044d5b3640 1 -- 172.21.15.130:0/1832678197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04480af5f0 msgr2=0x7f04480ac690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.722+0000 7f044d5b3640 1 --2- 172.21.15.130:0/1832678197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04480af5f0 0x7f04480ac690 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f044000c780 tx=0x7f044000cc40 comp rx=0 tx=0).stop 2024-06-11T17:18:24.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.722+0000 7f044d5b3640 1 -- 172.21.15.130:0/1832678197 shutdown_connections 2024-06-11T17:18:24.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.722+0000 7f044d5b3640 1 --2- 172.21.15.130:0/1832678197 >> v2:172.21.15.130:6816/3863300924 conn(0x7f0428070d60 0x7f0428073220 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.722+0000 7f044d5b3640 1 --2- 172.21.15.130:0/1832678197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04480af5f0 0x7f04480ac690 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.722+0000 7f044d5b3640 1 --2- 172.21.15.130:0/1832678197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04480707e0 0x7f0448143940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.722+0000 7f044d5b3640 1 --2- 172.21.15.130:0/1832678197 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f04480701a0 0x7f044806c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.722+0000 7f044d5b3640 1 -- 172.21.15.130:0/1832678197 >> 172.21.15.130:0/1832678197 conn(0x7f044806d910 msgr2=0x7f044813ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:24.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.722+0000 7f044d5b3640 1 -- 172.21.15.130:0/1832678197 shutdown_connections 2024-06-11T17:18:24.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.722+0000 7f044d5b3640 1 -- 172.21.15.130:0/1832678197 wait complete. 2024-06-11T17:18:24.735 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2024-06-11T17:18:22.814642+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218440,"kb_used_data":2144,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756280,"statfs":{"total":773094113280,"available":772870430720,"internally_reserved":0,"allocated":2195456,"data_stored":1388956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T17:18:20.576451+0000","last_change":"2024-06-11T17:18:20.575070+0000","last_active":"2024-06-11T17:18:20.576451+0000","last_peered":"2024-06-11T17:18:20.576451+0000","last_clean":"2024-06-11T17:18:20.576451+0000","last_became_active":"2024-06-11T17:18:20.574485+0000","last_became_peered":"2024-06-11T17:18:20.574485+0000","last_unstale":"2024-06-11T17:18:20.576451+0000","last_undegraded":"2024-06-11T17:18:20.576451+0000","last_fullsized":"2024-06-11T17:18:20.576451+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:34:37.729239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T17:18:20.574653+0000","last_change":"2024-06-11T17:18:20.573579+0000","last_active":"2024-06-11T17:18:20.574653+0000","last_peered":"2024-06-11T17:18:20.574653+0000","last_clean":"2024-06-11T17:18:20.574653+0000","last_became_active":"2024-06-11T17:18:20.573196+0000","last_became_peered":"2024-06-11T17:18:20.573196+0000","last_unstale":"2024-06-11T17:18:20.574653+0000","last_undegraded":"2024-06-11T17:18:20.574653+0000","last_fullsized":"2024-06-11T17:18:20.574653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:35:47.599808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T17:18:20.660687+0000","last_change":"2024-06-11T17:18:20.659201+0000","last_active":"2024-06-11T17:18:20.660687+0000","last_peered":"2024-06-11T17:18:20.660687+0000","last_clean":"2024-06-11T17:18:20.660687+0000","last_became_active":"2024-06-11T17:18:20.658322+0000","last_became_peered":"2024-06-11T17:18:20.658322+0000","last_unstale":"2024-06-11T17:18:20.660687+0000","last_undegraded":"2024-06-11T17:18:20.660687+0000","last_fullsized":"2024-06-11T17:18:20.660687+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:45:36.977745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T17:18:20.658181+0000","last_change":"2024-06-11T17:18:20.656553+0000","last_active":"2024-06-11T17:18:20.658181+0000","last_peered":"2024-06-11T17:18:20.658181+0000","last_clean":"2024-06-11T17:18:20.658181+0000","last_became_active":"2024-06-11T17:18:20.656011+0000","last_became_peered":"2024-06-11T17:18:20.656011+0000","last_unstale":"2024-06-11T17:18:20.658181+0000","last_undegraded":"2024-06-11T17:18:20.658181+0000","last_fullsized":"2024-06-11T17:18:20.658181+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:18:52.277227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T17:18:20.578533+0000","last_change":"2024-06-11T17:18:20.576498+0000","last_active":"2024-06-11T17:18:20.578533+0000","last_peered":"2024-06-11T17:18:20.578533+0000","last_clean":"2024-06-11T17:18:20.578533+0000","last_became_active":"2024-06-11T17:18:20.575917+0000","last_became_peered":"2024-06-11T17:18:20.575917+0000","last_unstale":"2024-06-11T17:18:20.578533+0000","last_undegraded":"2024-06-11T17:18:20.578533+0000","last_fullsized":"2024-06-11T17:18:20.578533+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:25:23.218922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T17:18:20.573399+0000","last_change":"2024-06-11T17:18:20.572075+0000","last_active":"2024-06-11T17:18:20.573399+0000","last_peered":"2024-06-11T17:18:20.573399+0000","last_clean":"2024-06-11T17:18:20.573399+0000","last_became_active":"2024-06-11T17:18:20.571627+0000","last_became_peered":"2024-06-11T17:18:20.571627+0000","last_unstale":"2024-06-11T17:18:20.573399+0000","last_undegraded":"2024-06-11T17:18:20.573399+0000","last_fullsized":"2024-06-11T17:18:20.573399+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:16:04.168325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T17:18:20.578843+0000","last_change":"2024-06-11T17:18:20.576662+0000","last_active":"2024-06-11T17:18:20.578843+0000","last_peered":"2024-06-11T17:18:20.578843+0000","last_clean":"2024-06-11T17:18:20.578843+0000","last_became_active":"2024-06-11T17:18:20.575851+0000","last_became_peered":"2024-06-11T17:18:20.575851+0000","last_unstale":"2024-06-11T17:18:20.578843+0000","last_undegraded":"2024-06-11T17:18:20.578843+0000","last_fullsized":"2024-06-11T17:18:20.578843+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:50:43.434269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T17:18:20.577295+0000","last_change":"2024-06-11T17:18:20.575928+0000","last_active":"2024-06-11T17:18:20.577295+0000","last_peered":"2024-06-11T17:18:20.577295+0000","last_clean":"2024-06-11T17:18:20.577295+0000","last_became_active":"2024-06-11T17:18:20.575356+0000","last_became_peered":"2024-06-11T17:18:20.575356+0000","last_unstale":"2024-06-11T17:18:20.577295+0000","last_undegraded":"2024-06-11T17:18:20.577295+0000","last_fullsized":"2024-06-11T17:18:20.577295+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:26:53.818723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":99,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T17:18:21.305037+0000","last_change":"2024-06-11T17:18:20.659416+0000","last_active":"2024-06-11T17:18:21.305037+0000","last_peered":"2024-06-11T17:18:21.305037+0000","last_clean":"2024-06-11T17:18:21.305037+0000","last_became_active":"2024-06-11T17:18:20.657407+0000","last_became_peered":"2024-06-11T17:18:20.657407+0000","last_unstale":"2024-06-11T17:18:21.305037+0000","last_undegraded":"2024-06-11T17:18:21.305037+0000","last_fullsized":"2024-06-11T17:18:21.305037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T05:02:12.022329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542147,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":671744,"data_stored":569066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":139264,"data_stored":40138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27168,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":147456,"data_stored":45136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":139264,"data_stored":40138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":671744,"data_stored":569066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":139264,"data_stored":40138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":147456,"data_stored":45136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":139264,"data_stored":40138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-11T17:18:24.736 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-11T17:18:24.854 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.854+0000 7f64e0b91640 1 Processor -- start 2024-06-11T17:18:24.854 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.854+0000 7f64e0b91640 1 -- start start 2024-06-11T17:18:24.855 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.858+0000 7f64e0b91640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f64dc140be0 0x7f64dc141020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.855 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.858+0000 7f64e0b91640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64dc141560 0x7f64dc14b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.856 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.858+0000 7f64e0b91640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64dc0aede0 con 0x7f64dc0aca80 2024-06-11T17:18:24.856 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.858+0000 7f64e0b91640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f64dc0ad790 con 0x7f64dc140be0 2024-06-11T17:18:24.856 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.858+0000 7f64e0b91640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f64dc0adbe0 con 0x7f64dc141560 2024-06-11T17:18:24.856 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.858+0000 7f64d9d9b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f64dc140be0 0x7f64dc141020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.856 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.858+0000 7f64dad9d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64dc141560 0x7f64dc14b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.856 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.858+0000 7f64d9d9b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f64dc140be0 0x7f64dc141020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38694/0 (socket says 172.21.15.130:38694) 2024-06-11T17:18:24.856 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.858+0000 7f64d9d9b640 1 -- 172.21.15.130:0/1125775834 learned_addr learned my addr 172.21.15.130:0/1125775834 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:24.856 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.858+0000 7f64d9d9b640 1 -- 172.21.15.130:0/1125775834 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64dc141560 msgr2=0x7f64dc14b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:24.856 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.858+0000 7f64d9d9b640 1 --2- 172.21.15.130:0/1125775834 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64dc141560 0x7f64dc14b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.856 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.858+0000 7f64d9d9b640 1 -- 172.21.15.130:0/1125775834 >> v1:172.21.15.130:6789/0 conn(0x7f64dc0aca80 legacy=0x7f64dc13dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.856 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.858+0000 7f64d9d9b640 1 -- 172.21.15.130:0/1125775834 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64dc0ad240 con 0x7f64dc140be0 2024-06-11T17:18:24.856 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.858+0000 7f64dad9d640 1 --2- 172.21.15.130:0/1125775834 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64dc141560 0x7f64dc14b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:18:24.857 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.858+0000 7f64d9d9b640 1 --2- 172.21.15.130:0/1125775834 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64dc140be0 0x7f64dc141020 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f64cc009870 tx=0x7f64cc01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f328ccc82bbbe2 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:24.857 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.858+0000 7f64d959a640 1 -- 172.21.15.130:0/1125775834 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64cc0aa430 con 0x7f64dc140be0 2024-06-11T17:18:24.858 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.858+0000 7f64d959a640 1 -- 172.21.15.130:0/1125775834 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64cc0af070 con 0x7f64dc140be0 2024-06-11T17:18:24.858 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.858+0000 7f64d959a640 1 -- 172.21.15.130:0/1125775834 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64cc0aa7f0 con 0x7f64dc140be0 2024-06-11T17:18:24.858 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.858+0000 7f64e0b91640 1 -- 172.21.15.130:0/1125775834 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64dc140be0 msgr2=0x7f64dc141020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.858 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.858+0000 7f64e0b91640 1 --2- 172.21.15.130:0/1125775834 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64dc140be0 0x7f64dc141020 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f64cc009870 tx=0x7f64cc01c4b0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.859 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.858+0000 7f64e0b91640 1 -- 172.21.15.130:0/1125775834 shutdown_connections 2024-06-11T17:18:24.859 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.858+0000 7f64e0b91640 1 --2- 172.21.15.130:0/1125775834 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64dc141560 0x7f64dc14b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.859 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.858+0000 7f64e0b91640 1 --2- 172.21.15.130:0/1125775834 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64dc140be0 0x7f64dc141020 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.859 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.858+0000 7f64e0b91640 1 -- 172.21.15.130:0/1125775834 >> 172.21.15.130:0/1125775834 conn(0x7f64dc0b46b0 msgr2=0x7f64dc0b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:24.859 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.858+0000 7f64e0b91640 1 -- 172.21.15.130:0/1125775834 shutdown_connections 2024-06-11T17:18:24.859 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.858+0000 7f64e0b91640 1 -- 172.21.15.130:0/1125775834 wait complete. 2024-06-11T17:18:24.861 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.862+0000 7f64e0b91640 1 Processor -- start 2024-06-11T17:18:24.861 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.862+0000 7f64e0b91640 1 -- start start 2024-06-11T17:18:24.861 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.862+0000 7f64e0b91640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64dc0aca80 0x7f64dc072f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.861 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.862+0000 7f64e0b91640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64dc140be0 0x7f64dc144f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.861 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.862+0000 7f64e0b91640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64dc141560 0x7f64dc070400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.861 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.862+0000 7f64e0b91640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f64dc14df30 con 0x7f64dc0aca80 2024-06-11T17:18:24.862 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.862+0000 7f64e0b91640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f64dc073dc0 con 0x7f64dc140be0 2024-06-11T17:18:24.862 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.862+0000 7f64e0b91640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f64dc14e0b0 con 0x7f64dc141560 2024-06-11T17:18:24.862 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.862+0000 7f64da59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64dc0aca80 0x7f64dc072f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.862 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.862+0000 7f64dad9d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64dc141560 0x7f64dc070400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.862 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.862+0000 7f64da59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64dc0aca80 0x7f64dc072f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38708/0 (socket says 172.21.15.130:38708) 2024-06-11T17:18:24.862 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.862+0000 7f64da59c640 1 -- 172.21.15.130:0/2700979527 learned_addr learned my addr 172.21.15.130:0/2700979527 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:24.862 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.862+0000 7f64dad9d640 1 -- 172.21.15.130:0/2700979527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64dc140be0 msgr2=0x7f64dc144f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.862 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.862+0000 7f64dad9d640 1 --2- 172.21.15.130:0/2700979527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64dc140be0 0x7f64dc144f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.862 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.862+0000 7f64dad9d640 1 -- 172.21.15.130:0/2700979527 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64dc0aca80 msgr2=0x7f64dc072f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:24.862 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.862+0000 7f64dad9d640 1 --2- 172.21.15.130:0/2700979527 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64dc0aca80 0x7f64dc072f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:24.862 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.862+0000 7f64dad9d640 1 -- 172.21.15.130:0/2700979527 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64dc146aa0 con 0x7f64dc141560 2024-06-11T17:18:24.862 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.862+0000 7f64da59c640 1 --2- 172.21.15.130:0/2700979527 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64dc0aca80 0x7f64dc072f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:18:24.863 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.862+0000 7f64dad9d640 1 --2- 172.21.15.130:0/2700979527 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64dc141560 0x7f64dc070400 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f64d400efc0 tx=0x7f64d400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:24.863 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.862+0000 7f64caffd640 1 -- 172.21.15.130:0/2700979527 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d4018030 con 0x7f64dc141560 2024-06-11T17:18:24.863 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.862+0000 7f64caffd640 1 -- 172.21.15.130:0/2700979527 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64d400cd30 con 0x7f64dc141560 2024-06-11T17:18:24.863 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.862+0000 7f64e0b91640 1 -- 172.21.15.130:0/2700979527 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64dc146d80 con 0x7f64dc141560 2024-06-11T17:18:24.863 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.862+0000 7f64caffd640 1 -- 172.21.15.130:0/2700979527 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d4003bc0 con 0x7f64dc141560 2024-06-11T17:18:24.863 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.862+0000 7f64e0b91640 1 -- 172.21.15.130:0/2700979527 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f64dc145d50 con 0x7f64dc141560 2024-06-11T17:18:24.863 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.862+0000 7f64e0b91640 1 -- 172.21.15.130:0/2700979527 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64dc141020 con 0x7f64dc141560 2024-06-11T17:18:24.864 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.862+0000 7f64caffd640 1 -- 172.21.15.130:0/2700979527 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f64d401b070 con 0x7f64dc141560 2024-06-11T17:18:24.864 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.862+0000 7f64caffd640 1 --2- 172.21.15.130:0/2700979527 >> v2:172.21.15.130:6816/3863300924 conn(0x7f64bc070d60 0x7f64bc073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:24.864 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.862+0000 7f64caffd640 1 -- 172.21.15.130:0/2700979527 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 4090+0+0 (secure 0 0 0) 0x7f64d4091250 con 0x7f64dc141560 2024-06-11T17:18:24.864 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.862+0000 7f64da59c640 1 --2- 172.21.15.130:0/2700979527 >> v2:172.21.15.130:6816/3863300924 conn(0x7f64bc070d60 0x7f64bc073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:24.864 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.866+0000 7f64da59c640 1 --2- 172.21.15.130:0/2700979527 >> v2:172.21.15.130:6816/3863300924 conn(0x7f64bc070d60 0x7f64bc073220 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f64d0001d00 tx=0x7f64d0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:24.866 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:24.866+0000 7f64caffd640 1 -- 172.21.15.130:0/2700979527 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7f64d4022070 con 0x7f64dc141560 2024-06-11T17:18:25.015 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.018+0000 7f64e0b91640 1 -- 172.21.15.130:0/2700979527 --> v2:172.21.15.130:6816/3863300924 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f64dc13b360 con 0x7f64bc070d60 2024-06-11T17:18:25.017 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.018+0000 7f64caffd640 1 -- 172.21.15.130:0/2700979527 <== mgr.4107 v2:172.21.15.130:6816/3863300924 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+35501 (secure 0 0 0) 0x7f64dc13b360 con 0x7f64bc070d60 2024-06-11T17:18:25.018 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:18:25.018 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2024-06-11T17:18:25.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.022+0000 7f64e0b91640 1 -- 172.21.15.130:0/2700979527 >> v2:172.21.15.130:6816/3863300924 conn(0x7f64bc070d60 msgr2=0x7f64bc073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:25.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.022+0000 7f64e0b91640 1 --2- 172.21.15.130:0/2700979527 >> v2:172.21.15.130:6816/3863300924 conn(0x7f64bc070d60 0x7f64bc073220 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f64d0001d00 tx=0x7f64d0009040 comp rx=0 tx=0).stop 2024-06-11T17:18:25.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.022+0000 7f64e0b91640 1 -- 172.21.15.130:0/2700979527 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64dc141560 msgr2=0x7f64dc070400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:25.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.022+0000 7f64e0b91640 1 --2- 172.21.15.130:0/2700979527 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64dc141560 0x7f64dc070400 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f64d400efc0 tx=0x7f64d400c490 comp rx=0 tx=0).stop 2024-06-11T17:18:25.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.022+0000 7f64e0b91640 1 -- 172.21.15.130:0/2700979527 shutdown_connections 2024-06-11T17:18:25.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.022+0000 7f64e0b91640 1 --2- 172.21.15.130:0/2700979527 >> v2:172.21.15.130:6816/3863300924 conn(0x7f64bc070d60 0x7f64bc073220 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:25.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.022+0000 7f64e0b91640 1 --2- 172.21.15.130:0/2700979527 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64dc141560 0x7f64dc070400 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:25.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.022+0000 7f64e0b91640 1 --2- 172.21.15.130:0/2700979527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64dc140be0 0x7f64dc144f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:25.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.022+0000 7f64e0b91640 1 --2- 172.21.15.130:0/2700979527 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64dc0aca80 0x7f64dc072f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:25.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.022+0000 7f64e0b91640 1 -- 172.21.15.130:0/2700979527 >> 172.21.15.130:0/2700979527 conn(0x7f64dc0b46b0 msgr2=0x7f64dc13ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:25.021 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.022+0000 7f64e0b91640 1 -- 172.21.15.130:0/2700979527 shutdown_connections 2024-06-11T17:18:25.021 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.022+0000 7f64e0b91640 1 -- 172.21.15.130:0/2700979527 wait complete. 2024-06-11T17:18:25.035 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2024-06-11T17:18:24.815071+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218480,"kb_used_data":2184,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756240,"statfs":{"total":773094113280,"available":772870389760,"internally_reserved":0,"allocated":2236416,"data_stored":1413946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000428"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T17:18:20.576451+0000","last_change":"2024-06-11T17:18:20.575070+0000","last_active":"2024-06-11T17:18:20.576451+0000","last_peered":"2024-06-11T17:18:20.576451+0000","last_clean":"2024-06-11T17:18:20.576451+0000","last_became_active":"2024-06-11T17:18:20.574485+0000","last_became_peered":"2024-06-11T17:18:20.574485+0000","last_unstale":"2024-06-11T17:18:20.576451+0000","last_undegraded":"2024-06-11T17:18:20.576451+0000","last_fullsized":"2024-06-11T17:18:20.576451+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:34:37.729239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-06-11T17:18:22.527584+0000","last_change":"2024-06-11T17:18:20.573579+0000","last_active":"2024-06-11T17:18:22.527584+0000","last_peered":"2024-06-11T17:18:22.527584+0000","last_clean":"2024-06-11T17:18:22.527584+0000","last_became_active":"2024-06-11T17:18:20.573196+0000","last_became_peered":"2024-06-11T17:18:20.573196+0000","last_unstale":"2024-06-11T17:18:22.527584+0000","last_undegraded":"2024-06-11T17:18:22.527584+0000","last_fullsized":"2024-06-11T17:18:22.527584+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:32:09.705134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-06-11T17:18:23.533021+0000","last_change":"2024-06-11T17:18:20.659201+0000","last_active":"2024-06-11T17:18:23.533021+0000","last_peered":"2024-06-11T17:18:23.533021+0000","last_clean":"2024-06-11T17:18:23.533021+0000","last_became_active":"2024-06-11T17:18:20.658322+0000","last_became_peered":"2024-06-11T17:18:20.658322+0000","last_unstale":"2024-06-11T17:18:23.533021+0000","last_undegraded":"2024-06-11T17:18:23.533021+0000","last_fullsized":"2024-06-11T17:18:23.533021+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T05:15:44.549344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-06-11T17:18:22.527708+0000","last_change":"2024-06-11T17:18:20.656553+0000","last_active":"2024-06-11T17:18:22.527708+0000","last_peered":"2024-06-11T17:18:22.527708+0000","last_clean":"2024-06-11T17:18:22.527708+0000","last_became_active":"2024-06-11T17:18:20.656011+0000","last_became_peered":"2024-06-11T17:18:20.656011+0000","last_unstale":"2024-06-11T17:18:22.527708+0000","last_undegraded":"2024-06-11T17:18:22.527708+0000","last_fullsized":"2024-06-11T17:18:22.527708+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:10:47.950547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-06-11T17:18:23.532038+0000","last_change":"2024-06-11T17:18:20.576498+0000","last_active":"2024-06-11T17:18:23.532038+0000","last_peered":"2024-06-11T17:18:23.532038+0000","last_clean":"2024-06-11T17:18:23.532038+0000","last_became_active":"2024-06-11T17:18:20.575917+0000","last_became_peered":"2024-06-11T17:18:20.575917+0000","last_unstale":"2024-06-11T17:18:23.532038+0000","last_undegraded":"2024-06-11T17:18:23.532038+0000","last_fullsized":"2024-06-11T17:18:23.532038+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:41:38.453105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-06-11T17:18:23.530670+0000","last_change":"2024-06-11T17:18:20.572075+0000","last_active":"2024-06-11T17:18:23.530670+0000","last_peered":"2024-06-11T17:18:23.530670+0000","last_clean":"2024-06-11T17:18:23.530670+0000","last_became_active":"2024-06-11T17:18:20.571627+0000","last_became_peered":"2024-06-11T17:18:20.571627+0000","last_unstale":"2024-06-11T17:18:23.530670+0000","last_undegraded":"2024-06-11T17:18:23.530670+0000","last_fullsized":"2024-06-11T17:18:23.530670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:15:20.179876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-06-11T17:18:23.533330+0000","last_change":"2024-06-11T17:18:20.576662+0000","last_active":"2024-06-11T17:18:23.533330+0000","last_peered":"2024-06-11T17:18:23.533330+0000","last_clean":"2024-06-11T17:18:23.533330+0000","last_became_active":"2024-06-11T17:18:20.575851+0000","last_became_peered":"2024-06-11T17:18:20.575851+0000","last_unstale":"2024-06-11T17:18:23.533330+0000","last_undegraded":"2024-06-11T17:18:23.533330+0000","last_fullsized":"2024-06-11T17:18:23.533330+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:49:51.271037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-06-11T17:18:23.532044+0000","last_change":"2024-06-11T17:18:20.575928+0000","last_active":"2024-06-11T17:18:23.532044+0000","last_peered":"2024-06-11T17:18:23.532044+0000","last_clean":"2024-06-11T17:18:23.532044+0000","last_became_active":"2024-06-11T17:18:20.575356+0000","last_became_peered":"2024-06-11T17:18:20.575356+0000","last_unstale":"2024-06-11T17:18:23.532044+0000","last_undegraded":"2024-06-11T17:18:23.532044+0000","last_fullsized":"2024-06-11T17:18:23.532044+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:57:32.714496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":102,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-06-11T17:18:23.533040+0000","last_change":"2024-06-11T17:18:20.659416+0000","last_active":"2024-06-11T17:18:23.533040+0000","last_peered":"2024-06-11T17:18:23.533040+0000","last_clean":"2024-06-11T17:18:23.533040+0000","last_became_active":"2024-06-11T17:18:20.657407+0000","last_became_peered":"2024-06-11T17:18:20.657407+0000","last_unstale":"2024-06-11T17:18:23.533040+0000","last_undegraded":"2024-06-11T17:18:23.533040+0000","last_fullsized":"2024-06-11T17:18:23.533040+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:15:37.551739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":679936,"data_stored":574064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":147456,"data_stored":45136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27168,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":147456,"data_stored":45136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":147456,"data_stored":45136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":679936,"data_stored":574064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":139264,"data_stored":40138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":147456,"data_stored":45136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":147456,"data_stored":45136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-11T17:18:25.036 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-11T17:18:25.036 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-06-11T17:18:25.037 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-06-11T17:18:25.037 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-06-11T17:18:25.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.150+0000 7fa331a62640 1 Processor -- start 2024-06-11T17:18:25.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.150+0000 7fa331a62640 1 -- start start 2024-06-11T17:18:25.150 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.150+0000 7fa331a62640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa32c0af310 0x7fa32c13f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:25.150 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.150+0000 7fa331a62640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa32c0ae6a0 0x7fa32c13ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:25.150 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.150+0000 7fa331a62640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa32c0aca90 con 0x7fa32c0aeaa0 2024-06-11T17:18:25.150 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.150+0000 7fa331a62640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fa32c0af6f0 con 0x7fa32c0af310 2024-06-11T17:18:25.150 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.150+0000 7fa331a62640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa32c0ad920 con 0x7fa32c0ae6a0 2024-06-11T17:18:25.150 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.150+0000 7fa32affd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa32c0ae6a0 0x7fa32c13ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:25.150 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.150+0000 7fa32b7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa32c0af310 0x7fa32c13f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:25.150 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.150+0000 7fa32affd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa32c0ae6a0 0x7fa32c13ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:53852/0 (socket says 172.21.15.130:53852) 2024-06-11T17:18:25.150 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.150+0000 7fa32b7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa32c0af310 0x7fa32c13f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38710/0 (socket says 172.21.15.130:38710) 2024-06-11T17:18:25.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.150+0000 7fa32affd640 1 -- 172.21.15.130:0/1391390709 learned_addr learned my addr 172.21.15.130:0/1391390709 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:25.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.150+0000 7fa32affd640 1 -- 172.21.15.130:0/1391390709 >> v2:172.21.15.130:3300/0 conn(0x7fa32c0af310 msgr2=0x7fa32c13f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:25.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.150+0000 7fa32affd640 1 --2- 172.21.15.130:0/1391390709 >> v2:172.21.15.130:3300/0 conn(0x7fa32c0af310 0x7fa32c13f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:25.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.150+0000 7fa32affd640 1 -- 172.21.15.130:0/1391390709 >> v1:172.21.15.172:6789/0 conn(0x7fa32c0aeaa0 legacy=0x7fa32c142d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:18:25.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.150+0000 7fa32affd640 1 -- 172.21.15.130:0/1391390709 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa32c0adc00 con 0x7fa32c0ae6a0 2024-06-11T17:18:25.152 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.150+0000 7fa32b7fe640 1 --2- 172.21.15.130:0/1391390709 >> v2:172.21.15.130:3300/0 conn(0x7fa32c0af310 0x7fa32c13f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:18:25.152 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.154+0000 7fa32affd640 1 --2- 172.21.15.130:0/1391390709 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa32c0ae6a0 0x7fa32c13ca80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa314009870 tx=0x7fa31401c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df33d8cb0cf042c4 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:25.153 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.154+0000 7fa32a7fc640 1 -- 172.21.15.130:0/1391390709 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3140b0070 con 0x7fa32c0ae6a0 2024-06-11T17:18:25.153 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.154+0000 7fa32a7fc640 1 -- 172.21.15.130:0/1391390709 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3140ab600 con 0x7fa32c0ae6a0 2024-06-11T17:18:25.153 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.154+0000 7fa32a7fc640 1 -- 172.21.15.130:0/1391390709 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3140ab9d0 con 0x7fa32c0ae6a0 2024-06-11T17:18:25.153 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.154+0000 7fa331a62640 1 -- 172.21.15.130:0/1391390709 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa32c0ae6a0 msgr2=0x7fa32c13ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:25.153 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.154+0000 7fa331a62640 1 --2- 172.21.15.130:0/1391390709 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa32c0ae6a0 0x7fa32c13ca80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa314009870 tx=0x7fa31401c4b0 comp rx=0 tx=0).stop 2024-06-11T17:18:25.154 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.154+0000 7fa331a62640 1 -- 172.21.15.130:0/1391390709 shutdown_connections 2024-06-11T17:18:25.154 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.154+0000 7fa331a62640 1 --2- 172.21.15.130:0/1391390709 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa32c0ae6a0 0x7fa32c13ca80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:25.154 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.154+0000 7fa331a62640 1 --2- 172.21.15.130:0/1391390709 >> v2:172.21.15.130:3300/0 conn(0x7fa32c0af310 0x7fa32c13f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:25.154 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.154+0000 7fa331a62640 1 -- 172.21.15.130:0/1391390709 >> 172.21.15.130:0/1391390709 conn(0x7fa32c0b46b0 msgr2=0x7fa32c0b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:25.154 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.154+0000 7fa331a62640 1 -- 172.21.15.130:0/1391390709 shutdown_connections 2024-06-11T17:18:25.154 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.154+0000 7fa331a62640 1 -- 172.21.15.130:0/1391390709 wait complete. 2024-06-11T17:18:25.156 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.154+0000 7fa331a62640 1 Processor -- start 2024-06-11T17:18:25.156 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.154+0000 7fa331a62640 1 -- start start 2024-06-11T17:18:25.156 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.158+0000 7fa331a62640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa32c0aeaa0 0x7fa32c0afba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:25.156 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.158+0000 7fa331a62640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa32c0af310 0x7fa32c13a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:25.156 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.158+0000 7fa331a62640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa32c13ae10 0x7fa32c1dc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:25.156 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.158+0000 7fa331a62640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa32c14d290 con 0x7fa32c0aeaa0 2024-06-11T17:18:25.156 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.158+0000 7fa331a62640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa32c14d110 con 0x7fa32c0af310 2024-06-11T17:18:25.156 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.158+0000 7fa331a62640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa32c14d410 con 0x7fa32c13ae10 2024-06-11T17:18:25.157 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.158+0000 7fa32b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa32c0aeaa0 0x7fa32c0afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:25.157 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.158+0000 7fa32bfff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa32c13ae10 0x7fa32c1dc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:25.157 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.158+0000 7fa32bfff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa32c13ae10 0x7fa32c1dc7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:53858/0 (socket says 172.21.15.130:53858) 2024-06-11T17:18:25.157 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.158+0000 7fa32b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa32c0aeaa0 0x7fa32c0afba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38712/0 (socket says 172.21.15.130:38712) 2024-06-11T17:18:25.157 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.158+0000 7fa32bfff640 1 -- 172.21.15.130:0/3043129287 learned_addr learned my addr 172.21.15.130:0/3043129287 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:18:25.157 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.158+0000 7fa32affd640 1 --2- 172.21.15.130:0/3043129287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa32c0af310 0x7fa32c13a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:25.157 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.158+0000 7fa32bfff640 1 -- 172.21.15.130:0/3043129287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa32c0af310 msgr2=0x7fa32c13a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:25.157 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.158+0000 7fa32bfff640 1 --2- 172.21.15.130:0/3043129287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa32c0af310 0x7fa32c13a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:25.157 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.158+0000 7fa32bfff640 1 -- 172.21.15.130:0/3043129287 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa32c0aeaa0 msgr2=0x7fa32c0afba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:25.157 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.158+0000 7fa32bfff640 1 --2- 172.21.15.130:0/3043129287 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa32c0aeaa0 0x7fa32c0afba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:25.157 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.158+0000 7fa32bfff640 1 -- 172.21.15.130:0/3043129287 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa32c13bdf0 con 0x7fa32c13ae10 2024-06-11T17:18:25.157 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.158+0000 7fa32b7fe640 1 --2- 172.21.15.130:0/3043129287 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa32c0aeaa0 0x7fa32c0afba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:18:25.157 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.158+0000 7fa32bfff640 1 --2- 172.21.15.130:0/3043129287 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa32c13ae10 0x7fa32c1dc7e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa31c00c3c0 tx=0x7fa31c00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:25.158 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.158+0000 7fa323fff640 1 -- 172.21.15.130:0/3043129287 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31c011790 con 0x7fa32c13ae10 2024-06-11T17:18:25.158 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.158+0000 7fa323fff640 1 -- 172.21.15.130:0/3043129287 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa31c017070 con 0x7fa32c13ae10 2024-06-11T17:18:25.158 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.158+0000 7fa331a62640 1 -- 172.21.15.130:0/3043129287 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa32c13c0d0 con 0x7fa32c13ae10 2024-06-11T17:18:25.158 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.158+0000 7fa323fff640 1 -- 172.21.15.130:0/3043129287 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31c011b70 con 0x7fa32c13ae10 2024-06-11T17:18:25.158 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.158+0000 7fa331a62640 1 -- 172.21.15.130:0/3043129287 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa32c13b2c0 con 0x7fa32c13ae10 2024-06-11T17:18:25.159 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.158+0000 7fa331a62640 1 -- 172.21.15.130:0/3043129287 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa32c13ca80 con 0x7fa32c13ae10 2024-06-11T17:18:25.159 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.158+0000 7fa323fff640 1 -- 172.21.15.130:0/3043129287 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7fa31c011d10 con 0x7fa32c13ae10 2024-06-11T17:18:25.159 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.158+0000 7fa323fff640 1 --2- 172.21.15.130:0/3043129287 >> v2:172.21.15.130:6816/3863300924 conn(0x7fa30c070d60 0x7fa30c073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:18:25.159 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.158+0000 7fa323fff640 1 -- 172.21.15.130:0/3043129287 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 4090+0+0 (secure 0 0 0) 0x7fa31c0907b0 con 0x7fa32c13ae10 2024-06-11T17:18:25.159 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.158+0000 7fa32b7fe640 1 --2- 172.21.15.130:0/3043129287 >> v2:172.21.15.130:6816/3863300924 conn(0x7fa30c070d60 0x7fa30c073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:18:25.159 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.158+0000 7fa32b7fe640 1 --2- 172.21.15.130:0/3043129287 >> v2:172.21.15.130:6816/3863300924 conn(0x7fa30c070d60 0x7fa30c073220 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa324009fd0 tx=0x7fa32400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:18:25.161 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.162+0000 7fa323fff640 1 -- 172.21.15.130:0/3043129287 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7fa31c05d190 con 0x7fa32c13ae10 2024-06-11T17:18:25.347 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.350+0000 7fa331a62640 1 -- 172.21.15.130:0/3043129287 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa32c076430 con 0x7fa32c13ae10 2024-06-11T17:18:25.348 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.350+0000 7fa323fff640 1 -- 172.21.15.130:0/3043129287 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fa31c05ca90 con 0x7fa32c13ae10 2024-06-11T17:18:25.348 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:18:25.348 INFO:teuthology.orchestra.run.smithi130.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-06-11T17:18:25.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.350+0000 7fa331a62640 1 -- 172.21.15.130:0/3043129287 >> v2:172.21.15.130:6816/3863300924 conn(0x7fa30c070d60 msgr2=0x7fa30c073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:25.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.350+0000 7fa331a62640 1 --2- 172.21.15.130:0/3043129287 >> v2:172.21.15.130:6816/3863300924 conn(0x7fa30c070d60 0x7fa30c073220 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa324009fd0 tx=0x7fa32400b040 comp rx=0 tx=0).stop 2024-06-11T17:18:25.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.350+0000 7fa331a62640 1 -- 172.21.15.130:0/3043129287 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa32c13ae10 msgr2=0x7fa32c1dc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:18:25.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.350+0000 7fa331a62640 1 --2- 172.21.15.130:0/3043129287 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa32c13ae10 0x7fa32c1dc7e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa31c00c3c0 tx=0x7fa31c00c880 comp rx=0 tx=0).stop 2024-06-11T17:18:25.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.350+0000 7fa331a62640 1 -- 172.21.15.130:0/3043129287 shutdown_connections 2024-06-11T17:18:25.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.350+0000 7fa331a62640 1 --2- 172.21.15.130:0/3043129287 >> v2:172.21.15.130:6816/3863300924 conn(0x7fa30c070d60 0x7fa30c073220 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:25.351 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.350+0000 7fa331a62640 1 --2- 172.21.15.130:0/3043129287 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa32c13ae10 0x7fa32c1dc7e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:25.351 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.350+0000 7fa331a62640 1 --2- 172.21.15.130:0/3043129287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa32c0af310 0x7fa32c13a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:25.351 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.350+0000 7fa331a62640 1 --2- 172.21.15.130:0/3043129287 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa32c0aeaa0 0x7fa32c0afba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:18:25.351 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.350+0000 7fa331a62640 1 -- 172.21.15.130:0/3043129287 >> 172.21.15.130:0/3043129287 conn(0x7fa32c0b46b0 msgr2=0x7fa32c0b4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:18:25.351 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.350+0000 7fa331a62640 1 -- 172.21.15.130:0/3043129287 shutdown_connections 2024-06-11T17:18:25.351 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:18:25.350+0000 7fa331a62640 1 -- 172.21.15.130:0/3043129287 wait complete. 2024-06-11T17:18:25.366 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-06-11T17:18:25.366 INFO:teuthology.run_tasks:Running task workunit... 2024-06-11T17:18:25.380 INFO:tasks.workunit:Pulling workunits from ref 37bbe1d8d788b7c9a71280e7d510c295a5853f0b 2024-06-11T17:18:25.380 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-06-11T17:18:25.381 DEBUG:teuthology.orchestra.run.smithi130:> stat -- /home/ubuntu/cephtest/mnt.0 2024-06-11T17:18:25.387 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-11T17:18:25.388 INFO:teuthology.orchestra.run.smithi130.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-06-11T17:18:25.388 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-06-11T17:18:25.435 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-06-11T17:18:25.435 DEBUG:teuthology.orchestra.run.smithi130:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-06-11T17:18:25.483 INFO:tasks.workunit:timeout=3h 2024-06-11T17:18:25.483 INFO:tasks.workunit:cleanup=True 2024-06-11T17:18:25.483 DEBUG:teuthology.orchestra.run.smithi130:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 37bbe1d8d788b7c9a71280e7d510c295a5853f0b 2024-06-11T17:18:25.533 INFO:tasks.workunit.client.0.smithi130.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-06-11T17:19:16.691 INFO:tasks.workunit.client.0.smithi130.stderr:Updating files: 97% (12022/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-06-11T17:19:17.488 INFO:tasks.workunit.client.0.smithi130.stderr:Note: switching to '37bbe1d8d788b7c9a71280e7d510c295a5853f0b'. 2024-06-11T17:19:17.488 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-06-11T17:19:17.488 INFO:tasks.workunit.client.0.smithi130.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-06-11T17:19:17.488 INFO:tasks.workunit.client.0.smithi130.stderr:changes and commit them, and you can discard any commits you make in this 2024-06-11T17:19:17.489 INFO:tasks.workunit.client.0.smithi130.stderr:state without impacting any branches by switching back to a branch. 2024-06-11T17:19:17.489 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-06-11T17:19:17.489 INFO:tasks.workunit.client.0.smithi130.stderr:If you want to create a new branch to retain commits you create, you may 2024-06-11T17:19:17.489 INFO:tasks.workunit.client.0.smithi130.stderr:do so (now or later) by using -c with the switch command. Example: 2024-06-11T17:19:17.489 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-06-11T17:19:17.489 INFO:tasks.workunit.client.0.smithi130.stderr: git switch -c 2024-06-11T17:19:17.489 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-06-11T17:19:17.489 INFO:tasks.workunit.client.0.smithi130.stderr:Or undo this operation with: 2024-06-11T17:19:17.489 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-06-11T17:19:17.489 INFO:tasks.workunit.client.0.smithi130.stderr: git switch - 2024-06-11T17:19:17.489 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-06-11T17:19:17.489 INFO:tasks.workunit.client.0.smithi130.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-06-11T17:19:17.489 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-06-11T17:19:17.489 INFO:tasks.workunit.client.0.smithi130.stderr:HEAD is now at 37bbe1d8d78 Merge branch 'wip-osd-ec-partial-reads' of https://github.com/rzarzynski/ceph into wip-lflores-testing-2-2024-06-10-1925 2024-06-11T17:19:17.496 DEBUG:teuthology.orchestra.run.smithi130:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-06-11T17:19:17.545 INFO:tasks.workunit.client.0.smithi130.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-06-11T17:19:17.548 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-06-11T17:19:17.548 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-06-11T17:19:18.284 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-06-11T17:19:18.360 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-06-11T17:19:18.413 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-06-11T17:19:18.414 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-06-11T17:19:18.414 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-06-11T17:19:18.456 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-06-11T17:19:18.460 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-06-11T17:19:18.461 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-06-11T17:19:18.507 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2024-06-11T17:19:18.508 INFO:tasks.workunit:Running workunit rados/test.sh... 2024-06-11T17:19:18.509 DEBUG:teuthology.orchestra.run.smithi130:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=37bbe1d8d788b7c9a71280e7d510c295a5853f0b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2024-06-11T17:19:18.560 INFO:tasks.workunit.client.0.smithi130.stderr:+ parallel=1 2024-06-11T17:19:18.560 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' '' = --serial ']' 2024-06-11T17:19:18.560 INFO:tasks.workunit.client.0.smithi130.stderr:+ crimson=0 2024-06-11T17:19:18.560 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' '' = --crimson ']' 2024-06-11T17:19:18.561 INFO:tasks.workunit.client.0.smithi130.stderr:+ color= 2024-06-11T17:19:18.561 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -t 1 ']' 2024-06-11T17:19:18.561 INFO:tasks.workunit.client.0.smithi130.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2024-06-11T17:19:18.561 INFO:tasks.workunit.client.0.smithi130.stderr:+ GTEST_OUTPUT_DIR=/home/ubuntu/cephtest/archive/unit_test_xml_report 2024-06-11T17:19:18.561 INFO:tasks.workunit.client.0.smithi130.stderr:+ mkdir -p /home/ubuntu/cephtest/archive/unit_test_xml_report 2024-06-11T17:19:18.562 INFO:tasks.workunit.client.0.smithi130.stderr:+ declare -A pids 2024-06-11T17:19:18.562 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-06-11T17:19:18.562 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.562 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s api_aio 2024-06-11T17:19:18.562 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' api_aio' 2024-06-11T17:19:18.563 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo api_aio 2024-06-11T17:19:18.563 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.565 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=api_aio 2024-06-11T17:19:18.565 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31503 2024-06-11T17:19:18.565 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test api_aio on pid 31503' 2024-06-11T17:19:18.565 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=31503 2024-06-11T17:19:18.566 INFO:tasks.workunit.client.0.smithi130.stdout:test api_aio on pid 31503 2024-06-11T17:19:18.567 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-06-11T17:19:18.567 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.567 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2024-06-11T17:19:18.567 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s api_aio_pp 2024-06-11T17:19:18.567 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' api_aio_pp' 2024-06-11T17:19:18.567 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo api_aio_pp 2024-06-11T17:19:18.567 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.567 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.568 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.568 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.568 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.568 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2024-06-11T17:19:18.568 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_rados_api_aio.log 2024-06-11T17:19:18.568 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ api_aio: /' 2024-06-11T17:19:18.569 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=api_aio_pp 2024-06-11T17:19:18.569 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31511 2024-06-11T17:19:18.569 INFO:tasks.workunit.client.0.smithi130.stdout:test api_aio_pp on pid 31511 2024-06-11T17:19:18.570 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test api_aio_pp on pid 31511' 2024-06-11T17:19:18.570 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=31511 2024-06-11T17:19:18.570 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-06-11T17:19:18.570 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2024-06-11T17:19:18.570 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.571 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s api_io 2024-06-11T17:19:18.571 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' api_io' 2024-06-11T17:19:18.571 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.571 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.571 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.571 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.571 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo api_io 2024-06-11T17:19:18.571 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2024-06-11T17:19:18.571 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.571 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_rados_api_aio_pp.log 2024-06-11T17:19:18.571 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ api_aio_pp: /' 2024-06-11T17:19:18.573 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=api_io 2024-06-11T17:19:18.573 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31519 2024-06-11T17:19:18.573 INFO:tasks.workunit.client.0.smithi130.stdout:test api_io on pid 31519 2024-06-11T17:19:18.575 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test api_io on pid 31519' 2024-06-11T17:19:18.575 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=31519 2024-06-11T17:19:18.575 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-06-11T17:19:18.575 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.575 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2024-06-11T17:19:18.575 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s api_io_pp 2024-06-11T17:19:18.575 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' api_io_pp' 2024-06-11T17:19:18.575 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo api_io_pp 2024-06-11T17:19:18.575 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.575 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.575 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.575 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.576 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.576 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2024-06-11T17:19:18.576 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_rados_api_io.log 2024-06-11T17:19:18.576 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ api_io: /' 2024-06-11T17:19:18.576 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=api_io_pp 2024-06-11T17:19:18.576 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31527 2024-06-11T17:19:18.577 INFO:tasks.workunit.client.0.smithi130.stdout:test api_io_pp on pid 31527 2024-06-11T17:19:18.577 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test api_io_pp on pid 31527' 2024-06-11T17:19:18.577 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=31527 2024-06-11T17:19:18.577 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-06-11T17:19:18.577 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.577 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2024-06-11T17:19:18.577 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s api_asio 2024-06-11T17:19:18.578 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' api_asio' 2024-06-11T17:19:18.579 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.579 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.579 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.579 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.579 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo api_asio 2024-06-11T17:19:18.579 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2024-06-11T17:19:18.579 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.579 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_rados_api_io_pp.log 2024-06-11T17:19:18.579 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ api_io_pp: /' 2024-06-11T17:19:18.582 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=api_asio 2024-06-11T17:19:18.582 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31535 2024-06-11T17:19:18.582 INFO:tasks.workunit.client.0.smithi130.stdout:test api_asio on pid 31535 2024-06-11T17:19:18.584 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test api_asio on pid 31535' 2024-06-11T17:19:18.584 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=31535 2024-06-11T17:19:18.584 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-06-11T17:19:18.584 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.584 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2024-06-11T17:19:18.584 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s api_list 2024-06-11T17:19:18.584 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' api_list' 2024-06-11T17:19:18.585 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo api_list 2024-06-11T17:19:18.585 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.585 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.585 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.585 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.585 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.585 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2024-06-11T17:19:18.585 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_rados_api_asio.log 2024-06-11T17:19:18.585 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ api_asio: /' 2024-06-11T17:19:18.586 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=api_list 2024-06-11T17:19:18.586 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31543 2024-06-11T17:19:18.586 INFO:tasks.workunit.client.0.smithi130.stdout:test api_list on pid 31543 2024-06-11T17:19:18.587 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test api_list on pid 31543' 2024-06-11T17:19:18.587 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=31543 2024-06-11T17:19:18.587 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-06-11T17:19:18.587 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2024-06-11T17:19:18.587 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.587 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s api_lock 2024-06-11T17:19:18.588 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' api_lock' 2024-06-11T17:19:18.588 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo api_lock 2024-06-11T17:19:18.588 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.588 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.588 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.588 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.588 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.588 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2024-06-11T17:19:18.588 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_rados_api_list.log 2024-06-11T17:19:18.588 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ api_list: /' 2024-06-11T17:19:18.589 INFO:tasks.workunit.client.0.smithi130.stdout:test api_lock on pid 31551 2024-06-11T17:19:18.589 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=api_lock 2024-06-11T17:19:18.589 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31551 2024-06-11T17:19:18.589 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test api_lock on pid 31551' 2024-06-11T17:19:18.589 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=31551 2024-06-11T17:19:18.590 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-06-11T17:19:18.590 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.590 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s api_lock_pp 2024-06-11T17:19:18.590 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' api_lock_pp' 2024-06-11T17:19:18.590 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo api_lock_pp 2024-06-11T17:19:18.590 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.590 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2024-06-11T17:19:18.592 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.592 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.592 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.592 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.592 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_rados_api_lock.log 2024-06-11T17:19:18.593 INFO:tasks.workunit.client.0.smithi130.stdout:test api_lock_pp on pid 31558 2024-06-11T17:19:18.593 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=api_lock_pp 2024-06-11T17:19:18.593 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31558 2024-06-11T17:19:18.594 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test api_lock_pp on pid 31558' 2024-06-11T17:19:18.594 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=31558 2024-06-11T17:19:18.594 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-06-11T17:19:18.594 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.594 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s api_misc 2024-06-11T17:19:18.594 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2024-06-11T17:19:18.594 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' api_misc' 2024-06-11T17:19:18.595 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2024-06-11T17:19:18.595 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.595 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.595 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.595 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.595 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ api_lock_pp: /' 2024-06-11T17:19:18.597 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ api_lock: /' 2024-06-11T17:19:18.597 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_rados_api_lock_pp.log 2024-06-11T17:19:18.603 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo api_misc 2024-06-11T17:19:18.603 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2024-06-11T17:19:18.612 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.616 INFO:tasks.workunit.client.0.smithi130.stdout:test api_misc on pid 31584 2024-06-11T17:19:18.616 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=api_misc 2024-06-11T17:19:18.616 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31584 2024-06-11T17:19:18.617 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test api_misc on pid 31584' 2024-06-11T17:19:18.617 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=31584 2024-06-11T17:19:18.617 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-06-11T17:19:18.617 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.617 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2024-06-11T17:19:18.617 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s api_misc_pp 2024-06-11T17:19:18.617 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' api_misc_pp' 2024-06-11T17:19:18.618 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.618 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.618 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.618 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.619 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_rados_api_misc.log 2024-06-11T17:19:18.619 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2024-06-11T17:19:18.619 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo api_misc_pp 2024-06-11T17:19:18.620 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ api_misc: /' 2024-06-11T17:19:18.621 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.629 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=api_misc_pp 2024-06-11T17:19:18.629 INFO:tasks.workunit.client.0.smithi130.stdout:test api_misc_pp on pid 31642 2024-06-11T17:19:18.630 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31642 2024-06-11T17:19:18.630 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test api_misc_pp on pid 31642' 2024-06-11T17:19:18.630 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=31642 2024-06-11T17:19:18.630 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-06-11T17:19:18.630 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.630 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2024-06-11T17:19:18.631 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.631 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.631 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.631 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.632 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s api_tier_pp 2024-06-11T17:19:18.632 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' api_tier_pp' 2024-06-11T17:19:18.633 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ api_misc_pp: /' 2024-06-11T17:19:18.634 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: [==========] Running 12 tests from 1 test suite. 2024-06-11T17:19:18.634 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: [----------] Global test environment set-up. 2024-06-11T17:19:18.634 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: [----------] 12 tests from AsioRados 2024-06-11T17:19:18.634 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.633+0000 7f8c7ab7c880 1 Processor -- start 2024-06-11T17:19:18.634 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.633+0000 7f8c7ab7c880 1 -- start start 2024-06-11T17:19:18.634 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.633+0000 7f8c7ab7c880 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x562d38440d80 0x562d3850f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:19:18.635 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.633+0000 7f8c7ab7c880 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d3847acf0 0x562d38511280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:19:18.635 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.633+0000 7f8c7ab7c880 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d38483ea0 0x562d38512180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:19:18.635 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.633+0000 7f8c7ab7c880 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562d3839c1a0 con 0x562d3847acf0 2024-06-11T17:19:18.635 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.633+0000 7f8c7ab7c880 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562d383f90d0 con 0x562d38483ea0 2024-06-11T17:19:18.635 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.633+0000 7f8c7ab7c880 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x562d38520ca0 con 0x562d38440d80 2024-06-11T17:19:18.635 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.633+0000 7f8c78691640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x562d38440d80 0x562d3850f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:19:18.635 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.633+0000 7f8c78691640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x562d38440d80 0x562d3850f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:59716/0 (socket says 172.21.15.130:59716) 2024-06-11T17:19:18.635 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.633+0000 7f8c78691640 1 -- 172.21.15.130:0/2389498903 learned_addr learned my addr 172.21.15.130:0/2389498903 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:19:18.635 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.633+0000 7f8c77e90640 1 --2- 172.21.15.130:0/2389498903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d3847acf0 0x562d38511280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:19:18.635 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.633+0000 7f8c78691640 1 -- 172.21.15.130:0/2389498903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d38483ea0 msgr2=0x562d38512180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:19:18.635 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.633+0000 7f8c78691640 1 --2- 172.21.15.130:0/2389498903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d38483ea0 0x562d38512180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:19:18.635 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.633+0000 7f8c78691640 1 -- 172.21.15.130:0/2389498903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d3847acf0 msgr2=0x562d38511280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:19:18.635 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.633+0000 7f8c78691640 1 --2- 172.21.15.130:0/2389498903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d3847acf0 0x562d38511280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:19:18.636 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_rados_api_misc_pp.log 2024-06-11T17:19:18.637 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.638 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo api_tier_pp 2024-06-11T17:19:18.641 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.633+0000 7f8c78691640 1 -- 172.21.15.130:0/2389498903 --> [v2:172.21.15.1test api_tier_pp on pid 31671 2024-06-11T17:19:18.643 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=api_tier_pp 2024-06-11T17:19:18.643 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31671 2024-06-11T17:19:18.643 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test api_tier_pp on pid 31671' 2024-06-11T17:19:18.643 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=31671 2024-06-11T17:19:18.643 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-06-11T17:19:18.643 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.643 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_tier_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_tier_pp.xml 2>&1 | tee ceph_test_rados_api_tier_pp.log | sed "s/^/ api_tier_pp: /"' 2024-06-11T17:19:18.643 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s api_pool 2024-06-11T17:19:18.643 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' api_pool' 2024-06-11T17:19:18.643 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo api_pool 2024-06-11T17:19:18.643 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.643 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.643 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.643 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.644 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.644 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_rados_api_tier_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_tier_pp.xml 2024-06-11T17:19:18.644 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ api_tier_pp: /' 2024-06-11T17:19:18.644 INFO:tasks.workunit.client.0.smithi130.stdout:test api_pool on pid 31680 2024-06-11T17:19:18.645 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=api_pool 2024-06-11T17:19:18.645 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2024-06-11T17:19:18.645 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31680 2024-06-11T17:19:18.645 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test api_pool on pid 31680' 2024-06-11T17:19:18.645 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=31680 2024-06-11T17:19:18.645 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-06-11T17:19:18.645 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.645 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_rados_api_tier_pp.log 2024-06-11T17:19:18.646 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2024-06-11T17:19:18.646 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s api_snapshots 2024-06-11T17:19:18.647 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' api_snapshots' 2024-06-11T17:19:18.647 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.647 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.647 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.647 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.647 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ api_pool: /' 2024-06-11T17:19:18.647 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2024-06-11T17:19:18.648 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.650 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_rados_api_pool.log 2024-06-11T17:19:18.653 INFO:tasks.workunit.client.0.smithi130.stdout:30:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d385117c0 con 0x562d38440d80 2024-06-11T17:19:18.653 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.637+0000 7f8c78691640 1 --2- 172.21.15.130:0/2389498903 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x562d38440d80 0x562d3850f2c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8c68018f60 tx=0x7f8c68003030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=145e3b321b8808ff server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:19:18.653 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.637+0000 7f8c76e8e640 1 -- 172.21.15.130:0/2389498903 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c680af040 con 0x562d38440d80 2024-06-11T17:19:18.653 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.637+0000 7f8c76e8e640 1 -- 172.21.15.130:0/2389498903 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c680bb070 con 0x562d38440d80 2024-06-11T17:19:18.653 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.641+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/2389498903 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x562d38440d80 msgr2=0x562d3850f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:19:18.653 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.641+0000 7f8c7ab7c880 1 --2- 172.21.15.130:0/2389498903 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x562d38440d80 0x562d3850f2c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8c68018f60 tx=0x7f8c68003030 comp rx=0 tx=0).stop 2024-06-11T17:19:18.653 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.641+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/2389498903 shutdown_connections 2024-06-11T17:19:18.653 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.641+0000 7f8c7ab7c880 1 --2- 172.21.15.130:0/2389498903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d38483ea0 0x562d38512180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:19:18.653 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.641+0000 7f8c7ab7c880 1 --2- 172.21.15.130:0/2389498903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d3847acf0 0x562d38511280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:19:18.653 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.641+0000 7f8c7ab7c880 1 --2- 172.21.15.130:0/2389498903 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x562d38440d80 0x562d3850f2c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:19:18.653 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.641+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/2389498903 >> 172.21.15.130:0/2389498903 conn(0x562d384813f0 msgr2=0x562d38515b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:19:18.653 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.649+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/2389498903 shutdown_connections 2024-06-11T17:19:18.653 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.653+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/2389498903 wait complete. 2024-06-11T17:19:18.654 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.653+0000 7f8c7ab7c880 1 Processor -- start 2024-06-11T17:19:18.654 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.653+0000 7f8c7ab7c880 1 -- start start 2024-06-11T17:19:18.654 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.653+0000 7f8c7ab7c880 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x562d3847acf0 0x562d38518ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:19:18.654 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.653+0000 7f8c7ab7c880 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d38483ea0 0x562d3851ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:19:18.654 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.653+0000 7f8c7ab7c880 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d3851b1b0 0x562d3851ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:19:18.654 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.653+0000 7f8c7ab7c880 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562d3847dac0 con 0x562d3851b1b0 2024-06-11T17:19:18.658 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo api_snapshots 2024-06-11T17:19:18.658 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=api_snapshots 2024-06-11T17:19:18.659 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.653+0000 7f8c7ab7c880 1 -- --> [v2:172.21.15.172:3300/test api_snapshots on pid 31721 2024-06-11T17:19:18.659 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31721 2024-06-11T17:19:18.659 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test api_snapshots on pid 31721' 2024-06-11T17:19:18.659 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=31721 2024-06-11T17:19:18.659 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-06-11T17:19:18.660 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.660 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2024-06-11T17:19:18.660 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s api_snapshots_pp 2024-06-11T17:19:18.660 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' api_snapshots_pp' 2024-06-11T17:19:18.660 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.660 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.660 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.660 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.661 INFO:tasks.workunit.client.0.smithi130.stdout:0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562d38515170 con 0x562d38483ea0 2024-06-11T17:19:18.661 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.653+0000 7f8c7ab7c880 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x562d3847cb80 con 0x562d3847acf0 2024-06-11T17:19:18.661 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.653+0000 7f8c77e90640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d38483ea0 0x562d3851ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:19:18.661 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.653+0000 7f8c77e90640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d38483ea0 0x562d3851ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.130:49014/0 (socket says 172.21.15.130:49014) 2024-06-11T17:19:18.661 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.653+0000 7f8c77e90640 1 -- 172.21.15.130:0/330960494 learned_addr learned my addr 172.21.15.130:0/330960494 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:19:18.661 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.653+0000 7f8c78691640 1 --2- 172.21.15.130:0/330960494 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x562d3847acf0 0x562d38518ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:19:18.661 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.653+0000 7f8c78e92640 1 --2- 172.21.15.130:0/330960494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d3851b1b0 0x562d3851ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:19:18.661 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.653+0000 7f8c78691640 1 -- 172.21.15.130:0/330960494 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d38483ea0 msgr2=0x562d3851ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:19:18.661 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.653+0000 7f8c78691640 1 --2- 172.21.15.130:0/330960494 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d38483ea0 0x562d3851ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:19:18.661 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.653+0000 7f8c78691640 1 -- 172.21.15.130:0/330960494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d3851b1b0 msgr2=0x562d3851ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:19:18.661 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.653+0000 7f8c78691640 1 --2- 172.21.15.130:0/330960494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d3851b1b0 0x562d3851ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:19:18.662 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.653+0000 7f8c78691640 1 -- 172.21.15.130:0/330960494 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d3850f4d0 con 0x562d3847acf0 2024-06-11T17:19:18.662 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.657+0000 7f8c78691640 1 --2- 172.21.15.130:0/330960494 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x562d3847acf0 0x562d38518ac0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8c68000c10 tx=0x7f8c680180d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:19:18.662 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.661+0000 7f8c75e8c640 1 -- 172.21.15.130:0/330960494 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c680af040 con 0x562d3847acf0 2024-06-11T17:19:18.662 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.661+0000 7f8c75e8c640 1 -- 172.21.15.130:0/330960494 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c680bb040 con 0x562d3847acf0 2024-06-11T17:19:18.662 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2024-06-11T17:19:18.662 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_rados_api_snapshots.log 2024-06-11T17:19:18.663 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ api_snapshots: /' 2024-06-11T17:19:18.663 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo api_snapshots_pp 2024-06-11T17:19:18.663 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.666 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=api_snapshots_pp 2024-06-11T17:19:18.666 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31733 2024-06-11T17:19:18.666 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.661+0000 7f8c75e8c640 1 -- 172.21.15.130:0/330960494 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c680c8test api_snapshots_pp on pid 31733 2024-06-11T17:19:18.667 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test api_snapshots_pp on pid 31733' 2024-06-11T17:19:18.667 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=31733 2024-06-11T17:19:18.667 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-06-11T17:19:18.667 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.667 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s api_stat 2024-06-11T17:19:18.667 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' api_stat' 2024-06-11T17:19:18.667 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo api_stat 2024-06-11T17:19:18.674 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2024-06-11T17:19:18.675 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.676 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.676 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.677 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.678 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.678 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2024-06-11T17:19:18.679 INFO:tasks.workunit.client.0.smithi130.stdout:test api_stat on pid 31766 2024-06-11T17:19:18.679 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=api_stat 2024-06-11T17:19:18.679 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31766 2024-06-11T17:19:18.679 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test api_stat on pid 31766' 2024-06-11T17:19:18.679 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=31766 2024-06-11T17:19:18.679 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-06-11T17:19:18.680 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.680 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2024-06-11T17:19:18.681 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s api_stat_pp 2024-06-11T17:19:18.681 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' api_stat_pp' 2024-06-11T17:19:18.681 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.681 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.681 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.681 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.681 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.681 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo api_stat_pp 2024-06-11T17:19:18.681 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2024-06-11T17:19:18.683 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=api_stat_pp 2024-06-11T17:19:18.683 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31775 2024-06-11T17:19:18.683 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test api_stat_pp on pid 31775' 2024-06-11T17:19:18.683 INFO:tasks.workunit.client.0.smithi130.stdout:test api_stat_pp on pid 31775 2024-06-11T17:19:18.684 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=31775 2024-06-11T17:19:18.684 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-06-11T17:19:18.684 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.684 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s api_watch_notify 2024-06-11T17:19:18.684 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' api_watch_notify' 2024-06-11T17:19:18.684 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.686 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo api_watch_notify 2024-06-11T17:19:18.687 INFO:tasks.workunit.client.0.smithi130.stdout:test api_watch_notify on pid 31782 2024-06-11T17:19:18.687 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=api_watch_notify 2024-06-11T17:19:18.687 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2024-06-11T17:19:18.687 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31782 2024-06-11T17:19:18.687 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test api_watch_notify on pid 31782' 2024-06-11T17:19:18.687 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=31782 2024-06-11T17:19:18.687 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-06-11T17:19:18.687 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.690 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ api_snapshots_pp: /' 2024-06-11T17:19:18.692 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_rados_api_stat.log 2024-06-11T17:19:18.692 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2024-06-11T17:19:18.693 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ api_stat: /' 2024-06-11T17:19:18.694 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.694 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.694 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.694 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.694 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2024-06-11T17:19:18.694 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_rados_api_stat_pp.log 2024-06-11T17:19:18.702 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2024-06-11T17:19:18.704 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.704 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.704 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.704 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.705 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_rados_api_watch_notify.log 2024-06-11T17:19:18.705 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s api_watch_notify_pp 2024-06-11T17:19:18.705 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' api_watch_notify_pp' 2024-06-11T17:19:18.705 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2024-06-11T17:19:18.705 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ api_watch_notify: /' 2024-06-11T17:19:18.713 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo api_watch_notify_pp 2024-06-11T17:19:18.714 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ api_stat_pp: /' 2024-06-11T17:19:18.720 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.723 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=api_watch_notify_pp 2024-06-11T17:19:18.724 INFO:tasks.workunit.client.0.smithi130.stdout:test api_watch_notify_pp on pid 31861 2024-06-11T17:19:18.724 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31861 2024-06-11T17:19:18.724 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test api_watch_notify_pp on pid 31861' 2024-06-11T17:19:18.724 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=31861 2024-06-11T17:19:18.724 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-06-11T17:19:18.725 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.725 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2024-06-11T17:19:18.725 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s api_cmd 2024-06-11T17:19:18.725 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' api_cmd' 2024-06-11T17:19:18.725 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.725 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.726 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.726 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.726 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2024-06-11T17:19:18.726 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2024-06-11T17:19:18.730 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo api_cmd 2024-06-11T17:19:18.732 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2024-06-11T17:19:18.735 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.742 INFO:tasks.workunit.client.0.smithi130.stdout:test api_cmd on pid 31919 2024-06-11T17:19:18.742 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=api_cmd 2024-06-11T17:19:18.742 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31919 2024-06-11T17:19:18.742 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test api_cmd on pid 31919' 2024-06-11T17:19:18.742 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=31919 2024-06-11T17:19:18.742 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-06-11T17:19:18.743 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.743 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s api_cmd_pp 2024-06-11T17:19:18.743 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' api_cmd_pp' 2024-06-11T17:19:18.743 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2024-06-11T17:19:18.744 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo api_cmd_pp 2024-06-11T17:19:18.744 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.744 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.744 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.744 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.744 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2024-06-11T17:19:18.744 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ api_cmd: /' 2024-06-11T17:19:18.744 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_rados_api_cmd.log 2024-06-11T17:19:18.744 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.746 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=api_cmd_pp 2024-06-11T17:19:18.746 INFO:tasks.workunit.client.0.smithi130.stdout:test api_cmd_pp on pid 31934 2024-06-11T17:19:18.746 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31934 2024-06-11T17:19:18.746 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test api_cmd_pp on pid 31934' 2024-06-11T17:19:18.746 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=31934 2024-06-11T17:19:18.747 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-06-11T17:19:18.747 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2024-06-11T17:19:18.747 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.747 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.747 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.747 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.748 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.748 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s api_service 2024-06-11T17:19:18.748 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2024-06-11T17:19:18.748 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ api_cmd_pp: /' 2024-06-11T17:19:18.748 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' api_service' 2024-06-11T17:19:18.749 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo api_service 2024-06-11T17:19:18.749 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.752 INFO:tasks.workunit.client.0.smithi130.stdout:test api_service on pid 31954 2024-06-11T17:19:18.752 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=api_service 2024-06-11T17:19:18.752 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31954 2024-06-11T17:19:18.752 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test api_service on pid 31954' 2024-06-11T17:19:18.753 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=31954 2024-06-11T17:19:18.753 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-06-11T17:19:18.753 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.753 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2024-06-11T17:19:18.753 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s api_service_pp 2024-06-11T17:19:18.753 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2024-06-11T17:19:18.753 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' api_service_pp' 2024-06-11T17:19:18.754 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo api_service_pp 2024-06-11T17:19:18.754 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.754 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.754 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.754 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.754 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.755 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2024-06-11T17:19:18.755 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_rados_api_service.log 2024-06-11T17:19:18.755 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ api_service: /' 2024-06-11T17:19:18.755 INFO:tasks.workunit.client.0.smithi130.stdout:test api_service_pp on pid 31964 2024-06-11T17:19:18.755 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=api_service_pp 2024-06-11T17:19:18.756 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31964 2024-06-11T17:19:18.756 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test api_service_pp on pid 31964' 2024-06-11T17:19:18.756 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=31964 2024-06-11T17:19:18.756 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-06-11T17:19:18.756 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.758 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s api_c_write_operations 2024-06-11T17:19:18.759 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2024-06-11T17:19:18.759 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' api_c_write_operations' 2024-06-11T17:19:18.760 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.760 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.760 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.761 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.761 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2024-06-11T17:19:18.763 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo api_c_write_operations 2024-06-11T17:19:18.766 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ api_service_pp: /' 2024-06-11T17:19:18.767 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.769 INFO:tasks.workunit.client.0.smithi130.stdout:test api_c_write_operations on pid 31994 2024-06-11T17:19:18.770 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=api_c_write_operations 2024-06-11T17:19:18.770 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31994 2024-06-11T17:19:18.770 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test api_c_write_operations on pid 31994' 2024-06-11T17:19:18.770 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=31994 2024-06-11T17:19:18.770 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-06-11T17:19:18.770 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.770 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2024-06-11T17:19:18.771 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_rados_api_service_pp.log 2024-06-11T17:19:18.771 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.771 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.771 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.772 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.772 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2024-06-11T17:19:18.772 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2024-06-11T17:19:18.773 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s api_c_read_operations 2024-06-11T17:19:18.773 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' api_c_read_operations' 2024-06-11T17:19:18.774 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo api_c_read_operations 2024-06-11T17:19:18.774 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.777 INFO:tasks.workunit.client.0.smithi130.stdout:test api_c_read_operations on pid 32004 2024-06-11T17:19:18.777 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=api_c_read_operations 2024-06-11T17:19:18.777 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=32004 2024-06-11T17:19:18.777 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test api_c_read_operations on pid 32004' 2024-06-11T17:19:18.777 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=32004 2024-06-11T17:19:18.778 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-06-11T17:19:18.778 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.778 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s list_parallel 2024-06-11T17:19:18.778 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2024-06-11T17:19:18.778 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' list_parallel' 2024-06-11T17:19:18.779 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo list_parallel 2024-06-11T17:19:18.779 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.779 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.779 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.779 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.779 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.779 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2024-06-11T17:19:18.780 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ api_c_read_operations: /' 2024-06-11T17:19:18.780 INFO:tasks.workunit.client.0.smithi130.stdout:test list_parallel on pid 32012 2024-06-11T17:19:18.781 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=list_parallel 2024-06-11T17:19:18.781 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=32012 2024-06-11T17:19:18.781 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test list_parallel on pid 32012' 2024-06-11T17:19:18.781 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=32012 2024-06-11T17:19:18.781 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-06-11T17:19:18.781 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.781 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s open_pools_parallel 2024-06-11T17:19:18.781 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2024-06-11T17:19:18.781 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' open_pools_parallel' 2024-06-11T17:19:18.782 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.782 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.782 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo open_pools_parallel 2024-06-11T17:19:18.783 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.783 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.783 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.783 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ api_c_write_operations: /' 2024-06-11T17:19:18.783 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2024-06-11T17:19:18.783 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=open_pools_parallel 2024-06-11T17:19:18.783 INFO:tasks.workunit.client.0.smithi130.stdout:test open_pools_parallel on pid 32030 2024-06-11T17:19:18.784 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=32030 2024-06-11T17:19:18.784 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test open_pools_parallel on pid 32030' 2024-06-11T17:19:18.784 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=32030 2024-06-11T17:19:18.784 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-06-11T17:19:18.785 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.785 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s delete_pools_parallel 2024-06-11T17:19:18.785 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' delete_pools_parallel' 2024-06-11T17:19:18.785 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo delete_pools_parallel 2024-06-11T17:19:18.785 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2024-06-11T17:19:18.787 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.787 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.787 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.787 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.787 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2024-06-11T17:19:18.788 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ list_parallel: /' 2024-06-11T17:19:18.788 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.790 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=delete_pools_parallel 2024-06-11T17:19:18.790 INFO:tasks.workunit.client.0.smithi130.stdout:test delete_pools_parallel on pid 32047 2024-06-11T17:19:18.791 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=32047 2024-06-11T17:19:18.791 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test delete_pools_parallel on pid 32047' 2024-06-11T17:19:18.791 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=32047 2024-06-11T17:19:18.791 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-06-11T17:19:18.791 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.791 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s cls 2024-06-11T17:19:18.791 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' cls' 2024-06-11T17:19:18.792 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ open_pools_parallel: /' 2024-06-11T17:19:18.792 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2024-06-11T17:19:18.793 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2024-06-11T17:19:18.795 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.796 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.796 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.796 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.796 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_rados_list_parallel.log 2024-06-11T17:19:18.798 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2024-06-11T17:19:18.800 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2024-06-11T17:19:18.802 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ delete_pools_parallel: /' 2024-06-11T17:19:18.806 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2024-06-11T17:19:18.809 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.810 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo cls 2024-06-11T17:19:18.818 INFO:tasks.workunit.client.0.smithi130.stdout:test cls on pid 32097 2024-06-11T17:19:18.818 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=cls 2024-06-11T17:19:18.818 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=32097 2024-06-11T17:19:18.818 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test cls on pid 32097' 2024-06-11T17:19:18.818 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=32097 2024-06-11T17:19:18.819 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-06-11T17:19:18.819 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.819 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s cmd 2024-06-11T17:19:18.820 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' cmd' 2024-06-11T17:19:18.820 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cls 2>&1 | tee ceph_test_neorados_cls.log | sed "s/^/ cls: /"' 2024-06-11T17:19:18.821 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.821 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.821 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.821 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.822 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_neorados_cls 2024-06-11T17:19:18.833 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_neorados_cls.log 2024-06-11T17:19:18.833 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ cls: /' 2024-06-11T17:19:18.833 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.834 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo cmd 2024-06-11T17:19:18.836 INFO:tasks.workunit.client.0.smithi130.stdout:test cmd on pid 32133 2024-06-11T17:19:18.837 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=cmd 2024-06-11T17:19:18.837 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=32133 2024-06-11T17:19:18.837 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test cmd on pid 32133' 2024-06-11T17:19:18.838 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=32133 2024-06-11T17:19:18.838 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-06-11T17:19:18.838 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.838 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cmd 2>&1 | tee ceph_test_neorados_cmd.log | sed "s/^/ cmd: /"' 2024-06-11T17:19:18.838 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s handler_error 2024-06-11T17:19:18.838 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' handler_error' 2024-06-11T17:19:18.840 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.840 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.840 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.840 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.840 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_neorados_cmd.log 2024-06-11T17:19:18.841 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_neorados_cmd 2024-06-11T17:19:18.845 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ cmd: /' 2024-06-11T17:19:18.861 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.868 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo handler_error 2024-06-11T17:19:18.870 INFO:tasks.workunit.client.0.smithi130.stdout:test handler_error on pid 32230 2024-06-11T17:19:18.870 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=handler_error 2024-06-11T17:19:18.870 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=32230 2024-06-11T17:19:18.870 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test handler_error on pid 32230' 2024-06-11T17:19:18.870 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=32230 2024-06-11T17:19:18.870 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-06-11T17:19:18.870 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.871 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s io 2024-06-11T17:19:18.871 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_handler_error 2>&1 | tee ceph_test_neorados_handler_error.log | sed "s/^/ handler_error: /"' 2024-06-11T17:19:18.872 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' io' 2024-06-11T17:19:18.874 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.875 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.875 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.875 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.877 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_neorados_handler_error.log 2024-06-11T17:19:18.877 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_neorados_handler_error 2024-06-11T17:19:18.878 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.887 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ handler_error: /' 2024-06-11T17:19:18.888 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo io 2024-06-11T17:19:18.890 INFO:tasks.workunit.client.0.smithi130.stdout:test io on pid 32318 2024-06-11T17:19:18.890 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=io 2024-06-11T17:19:18.890 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=32318 2024-06-11T17:19:18.890 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test io on pid 32318' 2024-06-11T17:19:18.891 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=32318 2024-06-11T17:19:18.891 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-06-11T17:19:18.891 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.896 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s ec_io 2024-06-11T17:19:18.897 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_io 2>&1 | tee ceph_test_neorados_io.log | sed "s/^/ io: /"' 2024-06-11T17:19:18.897 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.897 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.897 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.897 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.897 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_neorados_io 2024-06-11T17:19:18.897 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_neorados_io.log 2024-06-11T17:19:18.898 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ io: /' 2024-06-11T17:19:18.898 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' ec_io' 2024-06-11T17:19:18.901 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo ec_io 2024-06-11T17:19:18.901 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.902 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=ec_io 2024-06-11T17:19:18.902 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=32345 2024-06-11T17:19:18.902 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test ec_io on pid 32345' 2024-06-11T17:19:18.903 INFO:tasks.workunit.client.0.smithi130.stdout:test ec_io on pid 32345 2024-06-11T17:19:18.903 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=32345 2024-06-11T17:19:18.904 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-06-11T17:19:18.904 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.904 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_io 2>&1 | tee ceph_test_neorados_ec_io.log | sed "s/^/ ec_io: /"' 2024-06-11T17:19:18.904 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s list 2024-06-11T17:19:18.904 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' list' 2024-06-11T17:19:18.904 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.904 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.904 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.904 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.904 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_neorados_ec_io 2024-06-11T17:19:18.905 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_neorados_ec_io.log 2024-06-11T17:19:18.905 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.907 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo list 2024-06-11T17:19:18.908 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ ec_io: /' 2024-06-11T17:19:18.909 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=list 2024-06-11T17:19:18.910 INFO:tasks.workunit.client.0.smithi130.stdout:test list on pid 32365 2024-06-11T17:19:18.910 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=32365 2024-06-11T17:19:18.910 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test list on pid 32365' 2024-06-11T17:19:18.910 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=32365 2024-06-11T17:19:18.911 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-06-11T17:19:18.911 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_list 2>&1 | tee ceph_test_neorados_list.log | sed "s/^/ list: /"' 2024-06-11T17:19:18.911 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.911 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s ec_list 2024-06-11T17:19:18.912 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' ec_list' 2024-06-11T17:19:18.912 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.912 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.912 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.912 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.912 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo ec_list 2024-06-11T17:19:18.912 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_neorados_list.log 2024-06-11T17:19:18.912 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ list: /' 2024-06-11T17:19:18.913 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.913 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_neorados_list 2024-06-11T17:19:18.915 INFO:tasks.workunit.client.0.smithi130.stdout:test ec_list on pid 32380 2024-06-11T17:19:18.916 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=ec_list 2024-06-11T17:19:18.916 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=32380 2024-06-11T17:19:18.916 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test ec_list on pid 32380' 2024-06-11T17:19:18.916 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=32380 2024-06-11T17:19:18.916 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-06-11T17:19:18.916 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.916 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_list 2>&1 | tee ceph_test_neorados_ec_list.log | sed "s/^/ ec_list: /"' 2024-06-11T17:19:18.916 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s misc 2024-06-11T17:19:18.917 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' misc' 2024-06-11T17:19:18.917 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.917 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.917 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.918 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.918 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo misc 2024-06-11T17:19:18.919 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.919 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_neorados_ec_list 2024-06-11T17:19:18.920 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_neorados_ec_list.log 2024-06-11T17:19:18.921 INFO:tasks.workunit.client.0.smithi130.stdout:test misc on pid 32389 2024-06-11T17:19:18.922 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=misc 2024-06-11T17:19:18.922 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=32389 2024-06-11T17:19:18.922 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test misc on pid 32389' 2024-06-11T17:19:18.923 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=32389 2024-06-11T17:19:18.923 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ ec_list: /' 2024-06-11T17:19:18.923 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-06-11T17:19:18.923 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.923 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s pool 2024-06-11T17:19:18.924 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' pool' 2024-06-11T17:19:18.924 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_misc 2>&1 | tee ceph_test_neorados_misc.log | sed "s/^/ misc: /"' 2024-06-11T17:19:18.924 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo pool 2024-06-11T17:19:18.926 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.926 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.926 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.926 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.927 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ misc: /' 2024-06-11T17:19:18.927 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_neorados_misc 2024-06-11T17:19:18.927 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.928 INFO:tasks.workunit.client.0.smithi130.stdout:test pool on pid 32412 2024-06-11T17:19:18.929 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=pool 2024-06-11T17:19:18.929 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=32412 2024-06-11T17:19:18.929 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test pool on pid 32412' 2024-06-11T17:19:18.930 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=32412 2024-06-11T17:19:18.930 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-06-11T17:19:18.930 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.930 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s read_operations 2024-06-11T17:19:18.930 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' read_operations' 2024-06-11T17:19:18.930 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_neorados_misc.log 2024-06-11T17:19:18.931 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_pool 2>&1 | tee ceph_test_neorados_pool.log | sed "s/^/ pool: /"' 2024-06-11T17:19:18.933 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.933 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.934 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.934 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.934 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_neorados_pool 2024-06-11T17:19:18.934 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ pool: /' 2024-06-11T17:19:18.939 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo read_operations 2024-06-11T17:19:18.939 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.942 INFO:tasks.workunit.client.0.smithi130.stdout:test read_operations on pid 32449 2024-06-11T17:19:18.942 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=read_operations 2024-06-11T17:19:18.942 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=32449 2024-06-11T17:19:18.942 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test read_operations on pid 32449' 2024-06-11T17:19:18.943 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=32449 2024-06-11T17:19:18.943 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-06-11T17:19:18.943 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.944 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_neorados_pool.log 2024-06-11T17:19:18.945 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_read_operations 2>&1 | tee ceph_test_neorados_read_operations.log | sed "s/^/ read_operations: /"' 2024-06-11T17:19:18.947 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s snapshots 2024-06-11T17:19:18.947 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' snapshots' 2024-06-11T17:19:18.949 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.949 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.949 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.949 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.950 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_neorados_read_operations 2024-06-11T17:19:18.950 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo snapshots 2024-06-11T17:19:18.950 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ read_operations: /' 2024-06-11T17:19:18.951 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.953 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_neorados_read_operations.log 2024-06-11T17:19:18.955 INFO:tasks.workunit.client.0.smithi130.stdout:test snapshots on pid 32490 2024-06-11T17:19:18.955 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=snapshots 2024-06-11T17:19:18.955 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=32490 2024-06-11T17:19:18.955 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test snapshots on pid 32490' 2024-06-11T17:19:18.955 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=32490 2024-06-11T17:19:18.955 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-06-11T17:19:18.955 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.956 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s watch_notify 2024-06-11T17:19:18.956 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' watch_notify' 2024-06-11T17:19:18.957 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_snapshots 2>&1 | tee ceph_test_neorados_snapshots.log | sed "s/^/ snapshots: /"' 2024-06-11T17:19:18.960 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.960 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.960 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.960 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.960 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.960 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo watch_notify 2024-06-11T17:19:18.960 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_neorados_snapshots 2024-06-11T17:19:18.960 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_neorados_snapshots.log 2024-06-11T17:19:18.962 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=watch_notify 2024-06-11T17:19:18.962 INFO:tasks.workunit.client.0.smithi130.stdout:test watch_notify on pid 32513 2024-06-11T17:19:18.963 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=32513 2024-06-11T17:19:18.963 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test watch_notify on pid 32513' 2024-06-11T17:19:18.963 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=32513 2024-06-11T17:19:18.963 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-06-11T17:19:18.963 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_watch_notify 2>&1 | tee ceph_test_neorados_watch_notify.log | sed "s/^/ watch_notify: /"' 2024-06-11T17:19:18.963 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.964 INFO:tasks.workunit.client.0.smithi130.stderr:++ printf %25s write_operations 2024-06-11T17:19:18.964 INFO:tasks.workunit.client.0.smithi130.stderr:+ r=' write_operations' 2024-06-11T17:19:18.965 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.965 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.965 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.965 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.965 INFO:tasks.workunit.client.0.smithi130.stderr:++ echo write_operations 2024-06-11T17:19:18.965 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_neorados_watch_notify 2024-06-11T17:19:18.965 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_neorados_watch_notify.log 2024-06-11T17:19:18.965 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ watch_notify: /' 2024-06-11T17:19:18.970 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ snapshots: /' 2024-06-11T17:19:18.973 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1}' 2024-06-11T17:19:18.977 INFO:tasks.workunit.client.0.smithi130.stdout:test write_operations on pid 32533 2024-06-11T17:19:18.978 INFO:tasks.workunit.client.0.smithi130.stderr:+ ff=write_operations 2024-06-11T17:19:18.978 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=32533 2024-06-11T17:19:18.978 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'test write_operations on pid 32533' 2024-06-11T17:19:18.978 INFO:tasks.workunit.client.0.smithi130.stderr:+ pids[$f]=32533 2024-06-11T17:19:18.978 INFO:tasks.workunit.client.0.smithi130.stderr:+ ret=0 2024-06-11T17:19:18.978 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 1 ']' 2024-06-11T17:19:18.978 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:19:18.978 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31671 2024-06-11T17:19:18.978 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 31671 2024-06-11T17:19:18.979 INFO:tasks.workunit.client.0.smithi130.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_write_operations 2>&1 | tee ceph_test_neorados_write_operations.log | sed "s/^/ write_operations: /"' 2024-06-11T17:19:18.988 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z '' ']' 2024-06-11T17:19:18.988 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.988 INFO:tasks.workunit.client.0.smithi130.stderr:+ case $- in 2024-06-11T17:19:18.988 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 2024-06-11T17:19:18.991 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph_test_neorados_write_operations 2024-06-11T17:19:18.991 INFO:tasks.workunit.client.0.smithi130.stderr:+ tee ceph_test_neorados_write_operations.log 2024-06-11T17:19:18.991 INFO:tasks.workunit.client.0.smithi130.stderr:+ sed 's/^/ write_operations: /' 2024-06-11T17:19:18.999 INFO:tasks.workunit.client.0.smithi130.stdout:6e0 con 0x562d3847acf0 2024-06-11T17:19:18.999 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.661+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/330960494 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d38517350 con 0x562d3847acf0 2024-06-11T17:19:18.999 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.661+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/330960494 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x562d38519000 con 0x562d3847acf0 2024-06-11T17:19:18.999 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.665+0000 7f8c75e8c640 1 -- 172.21.15.130:0/330960494 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f8c680c8880 con 0x562d3847acf0 2024-06-11T17:19:18.999 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.665+0000 7f8c75e8c640 1 --2- 172.21.15.130:0/330960494 >> v2:172.21.15.130:6816/3863300924 conn(0x7f8c6406f750 0x7f8c64071c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:19:18.999 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.665+0000 7f8c75e8c640 1 -- 172.21.15.130:0/330960494 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 4090+0+0 (secure 0 0 0) 0x7f8c6812c9a0 con 0x562d3847acf0 2024-06-11T17:19:18.999 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.665+0000 7f8c77e90640 1 --2- 172.21.15.130:0/330960494 >> v2:172.21.15.130:6816/3863300924 conn(0x7f8c6406f750 0x7f8c64071c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:19:18.999 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.665+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/330960494 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8c680aa600 con 0x562d3847acf0 2024-06-11T17:19:18.999 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.665+0000 7f8c75e8c640 1 -- 172.21.15.130:0/330960494 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f8c680f4bd0 con 0x562d3847acf0 2024-06-11T17:19:19.000 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.665+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/330960494 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) -- 0x562d383fba20 con 0x562d3847acf0 2024-06-11T17:19:19.000 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.665+0000 7f8c77e90640 1 --2- 172.21.15.130:0/330960494 >> v2:172.21.15.130:6816/3863300924 conn(0x7f8c6406f750 0x7f8c64071c10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8c70005790 tx=0x7f8c70005d90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:19:19.000 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.977+0000 7f8c75e8c640 1 -- 172.21.15.130:0/330960494 <== mon.2 v2:172.21.15.130:3301/0 7 ==== pool_op_reply(tid 1 (0) Success v18) ==== 43+0+0 (secure 0 0 0) 0x7f8c68015040 con 0x562d3847acf0 2024-06-11T17:19:19.000 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.977+0000 7f8c75e8c640 1 -- 172.21.15.130:0/330960494 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=18}) -- 0x7f8c640750b0 con 0x562d3847acf0 2024-06-11T17:19:19.000 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.985+0000 7f8c75e8c640 1 -- 172.21.15.130:0/330960494 <== mon.2 v2:172.21.15.130:3301/0 8 ==== osd_map(18..18 src has 1..18) ==== 9172+0+0 (secure 0 0 0) 0x7f8c680f5300 con 0x562d3847acf0 2024-06-11T17:19:19.000 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.985+0000 7f8c7ab7c880 1 --2- 172.21.15.130:0/330960494 >> v2:172.21.15.130:6804/1676407705 conn(0x562d3851e920 0x562d385c4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:19:19.000 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:18.985+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/330960494 --> v2:172.21.15.130:6804/1676407705 -- osd_op(unknown.0.0:2 8.1 8:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18) -- 0x562d385c4fa0 con 0x562d3851e920 2024-06-11T17:19:20.241 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:19.001+0000 7f8c78e92640 1 --2- 172.21.15.130:0/330960494 >> v2:172.21.15.130:6804/1676407705 conn(0x562d3851e920 0x562d385c4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:19:20.242 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:19.025+0000 7f8c78e92640 1 --2- 172.21.15.130:0/330960494 >> v2:172.21.15.130:6804/1676407705 conn(0x562d3851e920 0x562d385c4a60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:19:20.242 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.209+0000 7f8c75e8c640 1 -- 172.21.15.130:0/330960494 <== osd.1 v2:172.21.15.130:6804/1676407705 1 ==== osd_map(19..19 src has 1..19) ==== 11884+0+0 (crc 0 0 0) 0x7f8c6c0103c0 con 0x562d3851e920 2024-06-11T17:19:20.242 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2024-06-11T17:19:20.242 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.237+0000 7f8c78e92640 1 -- 172.21.15.130:0/330960494 <== osd.1 v2:172.21.15.130:6804/1676407705 2 ==== osd_op_reply(2 exist [writefull 0~5] v19'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c6c00d040 con 0x562d3851e920 2024-06-11T17:19:20.242 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.237+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/330960494 --> v2:172.21.15.130:6804/1676407705 -- osd_op(unknown.0.0:3 8.1 8:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19) -- 0x562d385c1a40 con 0x562d3851e920 2024-06-11T17:19:20.242 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.237+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/330960494 --> v2:172.21.15.130:6804/1676407705 -- osd_op(unknown.0.0:4 8.1 8:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19) -- 0x562d385c22c0 con 0x562d3851e920 2024-06-11T17:19:20.242 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.237+0000 7f8c78e92640 1 -- 172.21.15.130:0/330960494 <== osd.1 v2:172.21.15.130:6804/1676407705 3 ==== osd_op_reply(3 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f8c6c00d040 con 0x562d3851e920 2024-06-11T17:19:20.242 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.237+0000 7f8c78e92640 1 -- 172.21.15.130:0/330960494 <== osd.1 v2:172.21.15.130:6804/1676407705 4 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8c6c00d040 con 0x562d3851e920 2024-06-11T17:19:20.242 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (1 ms) 2024-06-11T17:19:20.242 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2024-06-11T17:19:20.242 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.237+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/330960494 --> v2:172.21.15.130:6804/1676407705 -- osd_op(unknown.0.0:5 8.1 8:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19) -- 0x562d3851b590 con 0x562d3851e920 2024-06-11T17:19:20.243 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.237+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/330960494 --> v2:172.21.15.130:6804/1676407705 -- osd_op(unknown.0.0:6 8.1 8:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19) -- 0x562d385c57f0 con 0x562d3851e920 2024-06-11T17:19:20.243 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.241+0000 7f8c78e92640 1 -- 172.21.15.130:0/330960494 <== osd.1 v2:172.21.15.130:6804/1676407705 5 ==== osd_op_reply(5 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f8c6c00d040 con 0x562d3851e920 2024-06-11T17:19:20.243 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.241+0000 7f8c78e92640 1 -- 172.21.15.130:0/330960494 <== osd.1 v2:172.21.15.130:6804/1676407705 6 ==== osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8c6c00d040 con 0x562d3851e920 2024-06-11T17:19:20.243 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (4 ms) 2024-06-11T17:19:20.243 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2024-06-11T17:19:20.243 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.241+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/330960494 --> v2:172.21.15.130:6804/1676407705 -- osd_op(unknown.0.0:7 8.1 8:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19) -- 0x562d385c1e10 con 0x562d3851e920 2024-06-11T17:19:20.267 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.241+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/330960494 --> v2:172.21.15.130:6804/1676407705 -- osd_op(unknown.0.0:8 8.1 8:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19) -- 0x562d38606060 con 0x562d3851e920 2024-06-11T17:19:20.267 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.245+0000 7f8c78e92640 1 -- 172.21.15.130:0/330960494 <== osd.1 v2:172.21.15.130:6804/1676407705 7 ==== osd_op_reply(7 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f8c6c00d040 con 0x562d3851e920 2024-06-11T17:19:20.267 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.245+0000 7f8c78e92640 1 -- 172.21.15.130:0/330960494 <== osd.1 v2:172.21.15.130:6804/1676407705 8 ==== osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8c6c00d040 con 0x562d3851e920 2024-06-11T17:19:20.267 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (2 ms) 2024-06-11T17:19:20.268 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2024-06-11T17:19:20.268 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.245+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/330960494 --> v2:172.21.15.130:6804/1676407705 -- osd_op(unknown.0.0:9 8.1 8:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19) -- 0x562d385c6ba0 con 0x562d3851e920 2024-06-11T17:19:20.268 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.253+0000 7f8c78e92640 1 -- 172.21.15.130:0/330960494 <== osd.1 v2:172.21.15.130:6804/1676407705 9 ==== osd_op_reply(9 exist [write 0~5] v19'2 uv2 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c6c00d040 con 0x562d3851e920 2024-06-11T17:19:20.268 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (9 ms) 2024-06-11T17:19:20.268 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2024-06-11T17:19:20.269 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.253+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/330960494 --> v2:172.21.15.130:6804/1676407705 -- osd_op(unknown.0.0:10 8.1 8:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19) -- 0x562d385c6ba0 con 0x562d3851e920 2024-06-11T17:19:20.269 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.257+0000 7f8c78e92640 1 -- 172.21.15.130:0/330960494 <== osd.1 v2:172.21.15.130:6804/1676407705 10 ==== osd_op_reply(10 exist [write 0~5] v19'3 uv3 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c6c00d040 con 0x562d3851e920 2024-06-11T17:19:20.269 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (4 ms) 2024-06-11T17:19:20.269 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2024-06-11T17:19:20.269 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.257+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/330960494 --> v2:172.21.15.130:6804/1676407705 -- osd_op(unknown.0.0:11 8.1 8:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19) -- 0x562d385c6ba0 con 0x562d3851e920 2024-06-11T17:19:20.270 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.261+0000 7f8c78e92640 1 -- 172.21.15.130:0/330960494 <== osd.1 v2:172.21.15.130:6804/1676407705 11 ==== osd_op_reply(11 exist [write 0~5] v19'4 uv4 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c6c00d040 con 0x562d3851e920 2024-06-11T17:19:20.270 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (4 ms) 2024-06-11T17:19:20.270 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2024-06-11T17:19:20.270 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.261+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/330960494 --> v2:172.21.15.130:6804/1676407705 -- osd_op(unknown.0.0:12 8.1 8:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19) -- 0x562d385c5b90 con 0x562d3851e920 2024-06-11T17:19:20.270 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.261+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/330960494 --> v2:172.21.15.130:6804/1676407705 -- osd_op(unknown.0.0:13 8.1 8:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19) -- 0x562d385c64f0 con 0x562d3851e920 2024-06-11T17:19:20.270 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.269+0000 7f8c78e92640 1 -- 172.21.15.130:0/330960494 <== osd.1 v2:172.21.15.130:6804/1676407705 12 ==== osd_op_reply(12 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f8c6c00d040 con 0x562d3851e920 2024-06-11T17:19:20.276 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.269+0000 7f8c78e92640 1 -- 172.21.15.130:0/330960494 <== osd.1 v2:172.21.15.130:6804/1676407705 13 ==== osd_op_reply(13 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8c6c00d040 con 0x562d3851e920 2024-06-11T17:19:20.277 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (6 ms) 2024-06-11T17:19:20.277 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2024-06-11T17:19:20.277 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.269+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/330960494 --> v2:172.21.15.130:6804/1676407705 -- osd_op(unknown.0.0:14 8.1 8:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19) -- 0x562d385c6910 con 0x562d3851e920 2024-06-11T17:19:20.277 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.269+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/330960494 --> v2:172.21.15.130:6804/1676407705 -- osd_op(unknown.0.0:15 8.1 8:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19) -- 0x562d385c64f0 con 0x562d3851e920 2024-06-11T17:19:20.277 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.269+0000 7f8c78e92640 1 -- 172.21.15.130:0/330960494 <== osd.1 v2:172.21.15.130:6804/1676407705 14 ==== osd_op_reply(14 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f8c6c00d040 con 0x562d3851e920 2024-06-11T17:19:20.277 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.269+0000 7f8c78e92640 1 -- 172.21.15.130:0/330960494 <== osd.1 v2:172.21.15.130:6804/1676407705 15 ==== osd_op_reply(15 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8c6c00d040 con 0x562d3851e920 2024-06-11T17:19:20.277 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (1 ms) 2024-06-11T17:19:20.277 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2024-06-11T17:19:20.277 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.269+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/330960494 --> v2:172.21.15.130:6804/1676407705 -- osd_op(unknown.0.0:16 8.1 8:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19) -- 0x562d385c6910 con 0x562d3851e920 2024-06-11T17:19:20.277 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.269+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/330960494 --> v2:172.21.15.130:6804/1676407705 -- osd_op(unknown.0.0:17 8.1 8:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19) -- 0x562d385c64f0 con 0x562d3851e920 2024-06-11T17:19:20.277 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.269+0000 7f8c78e92640 1 -- 172.21.15.130:0/330960494 <== osd.1 v2:172.21.15.130:6804/1676407705 16 ==== osd_op_reply(16 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f8c6c00d040 con 0x562d3851e920 2024-06-11T17:19:20.277 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.269+0000 7f8c78e92640 1 -- 172.21.15.130:0/330960494 <== osd.1 v2:172.21.15.130:6804/1676407705 17 ==== osd_op_reply(17 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8c6c00d040 con 0x562d3851e920 2024-06-11T17:19:20.278 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (1 ms) 2024-06-11T17:19:20.278 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2024-06-11T17:19:20.278 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.269+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/330960494 --> v2:172.21.15.130:6804/1676407705 -- osd_op(unknown.0.0:18 8.1 8:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19) -- 0x562d385c6910 con 0x562d3851e920 2024-06-11T17:19:20.278 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.269+0000 7f8c78e92640 1 -- 172.21.15.130:0/330960494 <== osd.1 v2:172.21.15.130:6804/1676407705 18 ==== osd_op_reply(18 exist [writefull 0~5] v19'5 uv5 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c6c00d040 con 0x562d3851e920 2024-06-11T17:19:20.278 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (1 ms) 2024-06-11T17:19:20.278 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2024-06-11T17:19:20.278 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.269+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/330960494 --> v2:172.21.15.130:6804/1676407705 -- osd_op(unknown.0.0:19 8.1 8:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19) -- 0x562d385c68c0 con 0x562d3851e920 2024-06-11T17:19:20.298 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.277+0000 7f8c78e92640 1 -- 172.21.15.130:0/330960494 <== osd.1 v2:172.21.15.130:6804/1676407705 19 ==== osd_op_reply(19 exist [writefull 0~5] v19'6 uv6 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c6c00d040 con 0x562d3851e920 2024-06-11T17:19:20.298 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (8 ms) 2024-06-11T17:19:20.298 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2024-06-11T17:19:20.298 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.277+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/330960494 --> v2:172.21.15.130:6804/1676407705 -- osd_op(unknown.0.0:20 8.1 8:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19) -- 0x562d385c68c0 con 0x562d3851e920 2024-06-11T17:19:20.298 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.289+0000 7f8c78e92640 1 -- 172.21.15.130:0/330960494 <== osd.1 v2:172.21.15.130:6804/1676407705 20 ==== osd_op_reply(20 exist [writefull 0~5] v19'7 uv7 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c6c00d040 con 0x562d3851e920 2024-06-11T17:19:20.298 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (12 ms) 2024-06-11T17:19:20.298 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.289+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/330960494 >> v2:172.21.15.130:6804/1676407705 conn(0x562d3851e920 msgr2=0x562d385c4a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:19:20.298 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.289+0000 7f8c7ab7c880 1 --2- 172.21.15.130:0/330960494 >> v2:172.21.15.130:6804/1676407705 conn(0x562d3851e920 0x562d385c4a60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:19:20.299 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.289+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/330960494 >> v2:172.21.15.130:6816/3863300924 conn(0x7f8c6406f750 msgr2=0x7f8c64071c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:19:20.299 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.289+0000 7f8c7ab7c880 1 --2- 172.21.15.130:0/330960494 >> v2:172.21.15.130:6816/3863300924 conn(0x7f8c6406f750 0x7f8c64071c10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8c70005790 tx=0x7f8c70005d90 comp rx=0 tx=0).stop 2024-06-11T17:19:20.299 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.289+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/330960494 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x562d3847acf0 msgr2=0x562d38518ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:19:20.299 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.289+0000 7f8c7ab7c880 1 --2- 172.21.15.130:0/330960494 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x562d3847acf0 0x562d38518ac0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8c68000c10 tx=0x7f8c680180d0 comp rx=0 tx=0).stop 2024-06-11T17:19:20.299 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.289+0000 7f8c78e92640 1 -- 172.21.15.130:0/330960494 reap_dead start 2024-06-11T17:19:20.299 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.289+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/330960494 shutdown_connections 2024-06-11T17:19:20.299 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.289+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/330960494 >> 172.21.15.130:0/330960494 conn(0x562d384813f0 msgr2=0x562d38515b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:19:20.299 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.289+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/330960494 shutdown_connections 2024-06-11T17:19:20.299 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.293+0000 7f8c7ab7c880 1 -- 172.21.15.130:0/330960494 wait complete. 2024-06-11T17:19:20.299 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: [----------] 12 tests from AsioRados (53 ms total) 2024-06-11T17:19:20.299 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: 2024-06-11T17:19:20.299 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: [----------] Global test environment tear-down 2024-06-11T17:19:20.299 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: [==========] 12 tests from 1 test suite ran. (1660 ms total) 2024-06-11T17:19:20.300 INFO:tasks.workunit.client.0.smithi130.stdout: api_asio: [ PASSED ] 12 tests. 2024-06-11T17:19:20.701 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: [==========] Running 11 tests from 3 test suites. 2024-06-11T17:19:20.702 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: [----------] Global test environment set-up. 2024-06-11T17:19:20.702 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: [----------] 7 tests from LibRadosList 2024-06-11T17:19:20.702 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2024-06-11T17:19:20.702 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: [ OK ] LibRadosList.ListObjects (293 ms) 2024-06-11T17:19:20.702 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: [ RUN ] LibRadosList.ListObjectsZeroInName 2024-06-11T17:19:20.702 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: [ OK ] LibRadosList.ListObjectsZeroInName (35 ms) 2024-06-11T17:19:20.702 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2024-06-11T17:19:20.702 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: myset foo1,foo2,foo3 2024-06-11T17:19:20.702 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: foo1 2024-06-11T17:19:20.702 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: foo2 2024-06-11T17:19:20.703 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: foo3 2024-06-11T17:19:20.703 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: myset foo1,foo4,foo5 2024-06-11T17:19:20.703 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: foo4 2024-06-11T17:19:20.703 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: foo5 2024-06-11T17:19:20.703 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: foo1 2024-06-11T17:19:20.703 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: myset foo6,foo7 2024-06-11T17:19:20.703 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: foo7 2024-06-11T17:19:20.703 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: foo6 2024-06-11T17:19:20.703 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-06-11T17:19:20.703 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: ns1:foo4 2024-06-11T17:19:20.703 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: ns1:foo5 2024-06-11T17:19:20.703 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: ns2:foo7 2024-06-11T17:19:20.703 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: ns2:foo6 2024-06-11T17:19:20.704 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: ns1:foo1 2024-06-11T17:19:20.704 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: :foo1 2024-06-11T17:19:20.704 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: :foo2 2024-06-11T17:19:20.704 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: :foo3 2024-06-11T17:19:20.704 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (113 ms) 2024-06-11T17:19:20.704 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2024-06-11T17:19:20.704 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: 1 0 2024-06-11T17:19:20.704 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: 10 0 2024-06-11T17:19:20.704 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: 13 0 2024-06-11T17:19:20.704 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: 7 0 2024-06-11T17:19:20.704 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: 14 0 2024-06-11T17:19:20.704 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: 0 0 2024-06-11T17:19:20.704 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: 15 0 2024-06-11T17:19:20.705 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: 11 0 2024-06-11T17:19:20.705 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: 5 0 2024-06-11T17:19:20.705 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: 8 0 2024-06-11T17:19:20.705 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: 6 0 2024-06-11T17:19:20.705 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: 3 0 2024-06-11T17:19:20.705 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: 4 0 2024-06-11T17:19:20.705 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: 12 0 2024-06-11T17:19:20.705 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: 9 0 2024-06-11T17:19:20.705 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: 2 0 2024-06-11T17:19:20.705 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-06-11T17:19:20.705 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (149 ms) 2024-06-11T17:19:20.705 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2024-06-11T17:19:20.705 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: x cursor=MIN 2024-06-11T17:19:20.705 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > oid=1 cursor=9:02547ec2:::1:head 2024-06-11T17:19:20.706 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > oid=10 cursor=9:52ea6a34:::10:head 2024-06-11T17:19:20.706 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > oid=13 cursor=9:566253c9:::13:head 2024-06-11T17:19:20.706 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > oid=7 cursor=9:5c6b0b28:::7:head 2024-06-11T17:19:20.706 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > oid=14 cursor=9:62a1935d:::14:head 2024-06-11T17:19:20.706 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > oid=0 cursor=9:6cac518f:::0:head 2024-06-11T17:19:20.706 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > oid=15 cursor=9:863748b0:::15:head 2024-06-11T17:19:20.706 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > oid=11 cursor=9:89d3ae78:::11:head 2024-06-11T17:19:20.706 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > oid=5 cursor=9:b29083e3:::5:head 2024-06-11T17:19:20.706 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > oid=8 cursor=9:bd63b0f1:::8:head 2024-06-11T17:19:20.706 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > oid=6 cursor=9:c4fdafeb:::6:head 2024-06-11T17:19:20.706 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > oid=3 cursor=9:cfc208b3:::3:head 2024-06-11T17:19:20.706 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > oid=4 cursor=9:d83876eb:::4:head 2024-06-11T17:19:20.707 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > oid=12 cursor=9:de5d7c5f:::12:head 2024-06-11T17:19:20.707 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > oid=9 cursor=9:e960b815:::9:head 2024-06-11T17:19:20.707 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > oid=2 cursor=9:f905c69b:::2:head 2024-06-11T17:19:20.707 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: FIRST> seek to MIN oid=1 2024-06-11T17:19:20.707 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : oid=1 cursor=9:02547ec2:::1:head 2024-06-11T17:19:20.707 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : seek to 9:02547ec2:::1:head 2024-06-11T17:19:20.707 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > 9:02547ec2:::1:head -> 1 2024-06-11T17:19:20.707 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : oid=10 cursor=9:52ea6a34:::10:head 2024-06-11T17:19:20.707 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : seek to 9:52ea6a34:::10:head 2024-06-11T17:19:20.707 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > 9:52ea6a34:::10:head -> 10 2024-06-11T17:19:20.707 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : oid=13 cursor=9:566253c9:::13:head 2024-06-11T17:19:20.707 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : seek to 9:566253c9:::13:head 2024-06-11T17:19:20.707 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > 9:566253c9:::13:head -> 13 2024-06-11T17:19:20.707 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : oid=7 cursor=9:5c6b0b28:::7:head 2024-06-11T17:19:20.708 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : seek to 9:5c6b0b28:::7:head 2024-06-11T17:19:20.708 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > 9:5c6b0b28:::7:head -> 7 2024-06-11T17:19:20.708 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : oid=14 cursor=9:62a1935d:::14:head 2024-06-11T17:19:20.764 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : seek to 9:62a1935d:::14:head 2024-06-11T17:19:20.764 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > 9:62a1935d:::14:head -> 14 2024-06-11T17:19:20.764 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : oid=0 cursor=9:6cac518f:::0:head 2024-06-11T17:19:20.764 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : seek to 9:6cac518f:::0:head 2024-06-11T17:19:20.765 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > 9:6cac518f:::0:head -> 0 2024-06-11T17:19:20.765 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : oid=15 cursor=9:863748b0:::15:head 2024-06-11T17:19:20.765 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : seek to 9:863748b0:::15:head 2024-06-11T17:19:20.765 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > 9:863748b0:::15:head -> 15 2024-06-11T17:19:20.765 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : oid=11 cursor=9:89d3ae78:::11:head 2024-06-11T17:19:20.765 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : seek to 9:89d3ae78:::11:head 2024-06-11T17:19:20.765 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > 9:89d3ae78:::11:head -> 11 2024-06-11T17:19:20.765 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : oid=5 cursor=9:b29083e3:::5:head 2024-06-11T17:19:20.765 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : seek to 9:b29083e3:::5:head 2024-06-11T17:19:20.765 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > 9:b29083e3:::5:head -> 5 2024-06-11T17:19:20.765 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : oid=8 cursor=9:bd63b0f1:::8:head 2024-06-11T17:19:20.765 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : seek to 9:bd63b0f1:::8:head 2024-06-11T17:19:20.765 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > 9:bd63b0f1:::8:head -> 8 2024-06-11T17:19:20.766 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : oid=6 cursor=9:c4fdafeb:::6:head 2024-06-11T17:19:20.766 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : seek to 9:c4fdafeb:::6:head 2024-06-11T17:19:20.766 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > 9:c4fdafeb:::6:head -> 6 2024-06-11T17:19:20.766 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : oid=3 cursor=9:cfc208b3:::3:head 2024-06-11T17:19:20.766 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : seek to 9:cfc208b3:::3:head 2024-06-11T17:19:20.766 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > 9:cfc208b3:::3:head -> 3 2024-06-11T17:19:20.766 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : oid=4 cursor=9:d83876eb:::4:head 2024-06-11T17:19:20.766 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : seek to 9:d83876eb:::4:head 2024-06-11T17:19:20.766 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > 9:d83876eb:::4:head -> 4 2024-06-11T17:19:20.766 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : oid=12 cursor=9:de5d7c5f:::12:head 2024-06-11T17:19:20.766 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : seek to 9:de5d7c5f:::12:head 2024-06-11T17:19:20.766 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > 9:de5d7c5f:::12:head -> 12 2024-06-11T17:19:20.766 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : oid=9 cursor=9:e960b815:::9:head 2024-06-11T17:19:20.767 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : seek to 9:e960b815:::9:head 2024-06-11T17:19:20.767 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > 9:e960b815:::9:head -> 9 2024-06-11T17:19:20.767 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : oid=2 cursor=9:f905c69b:::2:head 2024-06-11T17:19:20.767 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : seek to 9:f905c69b:::2:head 2024-06-11T17:19:20.767 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > 9:f905c69b:::2:head -> 2 2024-06-11T17:19:20.767 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : seek to 9:d83876eb:::4:head 2024-06-11T17:19:20.767 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : cursor()=9:d83876eb:::4:head expected=9:d83876eb:::4:head 2024-06-11T17:19:20.767 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > 9:d83876eb:::4:head -> 4 2024-06-11T17:19:20.767 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : entry=4 expected=4 2024-06-11T17:19:20.767 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : seek to 9:cfc208b3:::3:head 2024-06-11T17:19:20.767 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : cursor()=9:cfc208b3:::3:head expected=9:cfc208b3:::3:head 2024-06-11T17:19:20.767 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > 9:cfc208b3:::3:head -> 3 2024-06-11T17:19:20.767 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : entry=3 expected=3 2024-06-11T17:19:20.767 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : seek to 9:6cac518f:::0:head 2024-06-11T17:19:20.767 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : cursor()=9:6cac518f:::0:head expected=9:6cac518f:::0:head 2024-06-11T17:19:20.768 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > 9:6cac518f:::0:head -> 0 2024-06-11T17:19:20.768 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : entry=0 expected=0 2024-06-11T17:19:20.768 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : seek to 9:f905c69b:::2:head 2024-06-11T17:19:20.768 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : cursor()=9:f905c69b:::2:head expected=9:f905c69b:::2:head 2024-06-11T17:19:20.768 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > 9:f905c69b:::2:head -> 2 2024-06-11T17:19:20.768 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : entry=2 expected=2 2024-06-11T17:19:20.768 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : seek to 9:e960b815:::9:head 2024-06-11T17:19:20.768 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : cursor()=9:e960b815:::9:head expected=9:e960b815:::9:head 2024-06-11T17:19:20.768 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > 9:e960b815:::9:head -> 9 2024-06-11T17:19:20.768 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : entry=9 expected=9 2024-06-11T17:19:20.768 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : seek to 9:de5d7c5f:::12:head 2024-06-11T17:19:20.769 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : cursor()=9:de5d7c5f:::12:head expected=9:de5d7c5f:::12:head 2024-06-11T17:19:20.769 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > 9:de5d7c5f:::12:head -> 12 2024-06-11T17:19:20.769 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : entry=12 expected=12 2024-06-11T17:19:20.769 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : seek to 9:02547ec2:::1:head 2024-06-11T17:19:20.769 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : cursor()=9:02547ec2:::1:head expected=9:02547ec2:::1:head 2024-06-11T17:19:20.769 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > 9:02547ec2:::1:head -> 1 2024-06-11T17:19:20.769 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : entry=1 expected=1 2024-06-11T17:19:20.769 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : seek to 9:c4fdafeb:::6:head 2024-06-11T17:19:20.769 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : cursor()=9:c4fdafeb:::6:head expected=9:c4fdafeb:::6:head 2024-06-11T17:19:20.769 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > 9:c4fdafeb:::6:head -> 6 2024-06-11T17:19:20.769 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : entry=6 expected=6 2024-06-11T17:19:20.769 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : seek to 9:bd63b0f1:::8:head 2024-06-11T17:19:21.046 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : curs api_c_read_operations: Running main() from gmock_main.cc 2024-06-11T17:19:21.047 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [==========] Running 17 tests from 1 test suite. 2024-06-11T17:19:21.047 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [----------] Global test environment set-up. 2024-06-11T17:19:21.047 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest 2024-06-11T17:19:21.047 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2024-06-11T17:19:21.047 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2024-06-11T17:19:21.047 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2024-06-11T17:19:21.047 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (254 ms) 2024-06-11T17:19:21.047 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2024-06-11T17:19:21.047 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (17 ms) 2024-06-11T17:19:21.047 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2024-06-11T17:19:21.047 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (11 ms) 2024-06-11T17:19:21.047 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2024-06-11T17:19:21.048 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (25 ms) 2024-06-11T17:19:21.048 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2024-06-11T17:19:21.048 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (9 ms) 2024-06-11T17:19:21.048 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2024-06-11T17:19:21.048 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (13 ms) 2024-06-11T17:19:21.048 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2024-06-11T17:19:21.048 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (10 ms) 2024-06-11T17:19:21.048 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2024-06-11T17:19:21.048 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (7 ms) 2024-06-11T17:19:21.048 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2024-06-11T17:19:21.048 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (13 ms) 2024-06-11T17:19:21.048 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2024-06-11T17:19:21.048 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (8 ms) 2024-06-11T17:19:21.048 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2024-06-11T17:19:21.049 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (11 ms) 2024-06-11T17:19:21.049 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat2 2024-06-11T17:19:21.049 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat2 (8 ms) 2024-06-11T17:19:21.049 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2024-06-11T17:19:21.049 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (26 ms) 2024-06-11T17:19:21.049 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2024-06-11T17:19:21.049 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (33 ms) 2024-06-11T17:19:21.049 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2024-06-11T17:19:21.049 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (21 ms) 2024-06-11T17:19:21.049 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2024-06-11T17:19:21.049 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (10 ms) 2024-06-11T17:19:21.049 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest (476 ms total) 2024-06-11T17:19:21.049 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: 2024-06-11T17:19:21.050 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [----------] Global test environment tear-down 2024-06-11T17:19:21.050 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [==========] 17 tests from 1 test suite ran. (2232 ms total) 2024-06-11T17:19:21.050 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_read_operations: [ PASSED ] 17 tests. 2024-06-11T17:19:21.533 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_1_[32076]: starting. 2024-06-11T17:19:21.533 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_1_[32076]: creating pool ceph_test_rados_list_parallel.smithi130-32023 2024-06-11T17:19:21.533 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_1_[32076]: created object 0... 2024-06-11T17:19:21.533 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_1_[32076]: created object 25... 2024-06-11T17:19:21.533 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_1_[32076]: created object 49... 2024-06-11T17:19:21.533 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_1_[32076]: finishing. 2024-06-11T17:19:21.533 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_1_[32076]: shutting down. 2024-06-11T17:19:21.533 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_2_[32077]: starting. 2024-06-11T17:19:21.534 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_2_[32077]: listing objects. 2024-06-11T17:19:21.534 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_2_[32077]: listed object 0... 2024-06-11T17:19:21.534 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_2_[32077]: listed object 25... 2024-06-11T17:19:21.534 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_2_[32077]: saw 50 objects 2024-06-11T17:19:21.534 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_2_[32077]: shutting down. 2024-06-11T17:19:21.534 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:21.534 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_3_[32708]: starting. 2024-06-11T17:19:21.534 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_3_[32708]: creating pool ceph_test_rados_list_parallel.smithi130-32023 2024-06-11T17:19:21.534 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_3_[32708]: created object 0... 2024-06-11T17:19:21.534 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_3_[32708]: created object 25... 2024-06-11T17:19:21.534 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_3_[32708]: created object 49... 2024-06-11T17:19:21.534 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_3_[32708]: finishing. 2024-06-11T17:19:21.534 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_3_[32708]: shutting down. 2024-06-11T17:19:21.534 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:21.535 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_4_[32709]: starting. 2024-06-11T17:19:21.535 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_4_[32709]: listing objects. 2024-06-11T17:19:21.535 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_4_[32709]: listed object 0... 2024-06-11T17:19:21.535 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_4_[32709]: listed object 25... 2024-06-11T17:19:21.535 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_4_[32709]: saw 47 objects 2024-06-11T17:19:21.535 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_4_[32709]: shutting down. 2024-06-11T17:19:21.535 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:21.535 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_5_[32710]: starting. 2024-06-11T17:19:21.535 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_5_[32710]: removed 25 objects... 2024-06-11T17:19:21.535 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_5_[32710]: removed half of the objects 2024-06-11T17:19:21.535 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_5_[32710]: removed 50 objects... 2024-06-11T17:19:21.535 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_5_[32710]: removed 50 objects 2024-06-11T17:19:21.535 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_5_[32710]: shutting down. 2024-06-11T17:19:21.536 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:21.536 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:21.536 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_6_[32759]: starting. 2024-06-11T17:19:21.536 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_6_[32759]: creating pool ceph_test_rados_list_parallel.smithi130-32023 2024-06-11T17:19:21.536 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_6_[32759]: created object 0... 2024-06-11T17:19:21.536 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_6_[32759]: created object 25... 2024-06-11T17:19:21.536 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_6_[32759]: created object 49... 2024-06-11T17:19:21.536 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_6_[32759]: finishing. 2024-06-11T17:19:21.536 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_6_[32759]: shutting down. 2024-06-11T17:19:21.536 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:21.536 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:21.536 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_7_[32760]: starting. 2024-06-11T17:19:21.536 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_7_[32760]: listing objects. 2024-06-11T17:19:21.536 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_7_[32760]: listed object 0... 2024-06-11T17:19:21.536 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_7_[32760]: listed object 25... 2024-06-11T17:19:21.537 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_7_[32760]: listed object 50... 2024-06-11T17:19:21.537 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_7_[32760]: saw 55 objects 2024-06-11T17:19:21.537 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_7_[32760]: shutting down. 2024-06-11T17:19:21.537 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:21.537 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:21.537 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_8_[32761]: starting. 2024-06-11T17:19:21.537 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_8_[32761]: added 25 objects... 2024-06-11T17:19:21.537 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_8_[32761]: added half of the objects 2024-06-11T17:19:21.537 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_8_[32761]: added 50 objects... 2024-06-11T17:19:21.537 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_8_[32761]: added 50 objects 2024-06-11T17:19:21.537 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_8_[32761]: shutting down. 2024-06-11T17:19:21.537 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:21.537 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:21.887 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:21.887 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_9_[33100]: starting. 2024-06-11T17:19:21.887 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_9_[33100]: creating pool ceph_test_rados_list_parallel.smithi130-32023 2024-06-11T17:19:21.887 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_9_[33100]: created object 0... 2024-06-11T17:19:21.887 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_9_[33100]: created object 25... 2024-06-11T17:19:21.887 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_9_[33100]: created object 49... 2024-06-11T17:19:21.887 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_9_[33100]: finishing. 2024-06-11T17:19:21.887 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_9_[33100]: shutting down. 2024-06-11T17:19:21.887 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:21.887 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:21.888 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:21.888 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_10_[33101]: starting. 2024-06-11T17:19:21.888 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_10_[33101]: listing objects. 2024-06-11T17:19:21.888 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_10_[33101]: listed object 0... 2024-06-11T17:19:21.888 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_10_[33101]: listed object 25... 2024-06-11T17:19:21.888 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_10_[33101]: listed object 50... 2024-06-11T17:19:21.888 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_10_[33101]: listed object 75... 2024-06-11T17:19:21.888 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_10_[33101]: saw 95 objects 2024-06-11T17:19:21.888 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_10_[33101]: shutting down. 2024-06-11T17:19:21.888 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:21.888 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:21.888 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:21.888 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_13_[33104]: starting. 2024-06-11T17:19:21.889 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_13_[33104]: removed 25 objects... 2024-06-11T17:19:21.889 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_13_[33104]: removed half of the objects 2024-06-11T17:19:21.889 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_13_[33104]: removed 50 objects... 2024-06-11T17:19:21.889 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_13_[33104]: removed 50 objects 2024-06-11T17:19:21.889 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_13_[33104]: shutting down. 2024-06-11T17:19:21.889 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:21.889 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:21.889 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:21.889 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_12_[33103]: starting. 2024-06-11T17:19:21.889 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_12_[33103]: added 25 objects... 2024-06-11T17:19:21.889 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_12_[33103]: added half of the objects 2024-06-11T17:19:21.889 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_12_[33103]: added 50 objects... 2024-06-11T17:19:21.889 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_12_[33103]: added 50 objects 2024-06-11T17:19:21.889 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_12_[33103]: shutting down. 2024-06-11T17:19:21.890 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:21.890 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:21.890 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:21.890 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_11_[33102]: starting. 2024-06-11T17:19:21.890 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_11_[33102]: added 25 objects... 2024-06-11T17:19:21.890 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_11_[33102]: added half of the objects 2024-06-11T17:19:21.890 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_11_[33102]: added 50 objects... 2024-06-11T17:19:21.890 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_11_[33102]: added 50 objects 2024-06-11T17:19:21.890 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_11_[33102]: shutting down. 2024-06-11T17:19:21.890 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:21.890 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:21.890 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:21.890 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:21.890 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_14_[33185]: starting. 2024-06-11T17:19:21.890 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_14_[33185]: creating pool ceph_test_rados_list_parallel.smithi130-32023 2024-06-11T17:19:21.891 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_14_[33185]: created object 0... 2024-06-11T17:19:21.891 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_14_[33185]: created object 25... 2024-06-11T17:19:21.891 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_14_[33185]: created object 49... 2024-06-11T17:19:21.891 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_14_[33185]: finishing. 2024-06-11T17:19:21.891 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_14_[33185]: shutting down. 2024-06-11T17:19:21.891 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:21.891 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:21.891 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:21.891 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:21.891 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_15_[33186]: starting. 2024-06-11T17:19:21.891 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_15_[33186]: listing objects. 2024-06-11T17:19:21.891 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_15_[33186]: listed object 0... 2024-06-11T17:19:22.035 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_15_[33186]: listed object 2 handler_error: Running main() from gmock_main.cc 2024-06-11T17:19:22.036 INFO:tasks.workunit.client.0.smithi130.stdout: handler_error: [==========] Running 1 test from 1 test suite. 2024-06-11T17:19:22.036 INFO:tasks.workunit.client.0.smithi130.stdout: handler_error: [----------] Global test environment set-up. 2024-06-11T17:19:22.036 INFO:tasks.workunit.client.0.smithi130.stdout: handler_error: [----------] 1 test from neocls_handler_error 2024-06-11T17:19:22.036 INFO:tasks.workunit.client.0.smithi130.stdout: handler_error: [ RUN ] neocls_handler_error.test_handler_error 2024-06-11T17:19:22.036 INFO:tasks.workunit.client.0.smithi130.stdout: handler_error: [ OK ] neocls_handler_error.test_handler_error (3141 ms) 2024-06-11T17:19:22.036 INFO:tasks.workunit.client.0.smithi130.stdout: handler_error: [----------] 1 test from neocls_handler_error (3141 ms total) 2024-06-11T17:19:22.036 INFO:tasks.workunit.client.0.smithi130.stdout: handler_error: 2024-06-11T17:19:22.036 INFO:tasks.workunit.client.0.smithi130.stdout: handler_error: [----------] Global test environment tear-down 2024-06-11T17:19:22.036 INFO:tasks.workunit.client.0.smithi130.stdout: handler_error: [==========] 1 test from 1 test suite ran. (3141 ms total) 2024-06-11T17:19:22.036 INFO:tasks.workunit.client.0.smithi130.stdout: handler_error: [ PASSED ] 1 test. 2024-06-11T17:19:22.036 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd_pp: Running main() from gmock_main.cc 2024-06-11T17:19:22.036 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2024-06-11T17:19:22.036 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd_pp: [----------] Global test environment set-up. 2024-06-11T17:19:22.037 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2024-06-11T17:19:22.037 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2024-06-11T17:19:22.037 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (71 ms) 2024-06-11T17:19:22.037 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2024-06-11T17:19:22.037 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (62 ms) 2024-06-11T17:19:22.037 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2024-06-11T17:19:22.037 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (3134 ms) 2024-06-11T17:19:22.037 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (3267 ms total) 2024-06-11T17:19:22.037 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd_pp: 2024-06-11T17:19:22.037 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd_pp: [----------] Global test environment tear-down 2024-06-11T17:19:22.037 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (3267 ms total) 2024-06-11T17:19:22.037 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2024-06-11T17:19:22.068 INFO:tasks.workunit.client.0.smithi130.stdout:5... 2024-06-11T17:19:22.068 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_15_[33186]: listed object 50... 2024-06-11T17:19:22.068 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_15_[33186]: listed object 75... 2024-06-11T17:19:22.069 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_15_[33186]: listed object 100... 2024-06-11T17:19:22.069 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_15_[33186]: listed object 125... 2024-06-11T17:19:22.069 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_15_[33186]: saw 150 objects 2024-06-11T17:19:22.069 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_15_[33186]: shutting down. 2024-06-11T17:19:22.069 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:22.069 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:22.069 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:22.069 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:22.069 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_16_[33187]: starting. 2024-06-11T17:19:22.069 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_16_[33187]: added 25 objects... 2024-06-11T17:19:22.069 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_16_[33187]: added half of the objects 2024-06-11T17:19:22.070 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_16_[33187]: added 50 objects... 2024-06-11T17:19:22.070 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_16_[33187]: added 50 objects 2024-06-11T17:19:22.070 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: process_16_[33187]: shutting down. 2024-06-11T17:19:22.070 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:22.070 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:22.070 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:22.070 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:22.070 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******************************* 2024-06-11T17:19:22.070 INFO:tasks.workunit.client.0.smithi130.stdout: list_parallel: ******* SUCCESS ********** 2024-06-11T17:19:22.150 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: Running main() from gmock_main.cc 2024-06-11T17:19:22.150 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2024-06-11T17:19:22.150 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: [----------] Global test environment set-up. 2024-06-11T17:19:22.150 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2024-06-11T17:19:22.151 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2024-06-11T17:19:22.151 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (65 ms) 2024-06-11T17:19:22.151 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2024-06-11T17:19:22.151 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (80 ms) 2024-06-11T17:19:22.151 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2024-06-11T17:19:22.151 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (3121 ms) 2024-06-11T17:19:22.151 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2024-06-11T17:19:22.151 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:20.992163+0000 mon.a [WRN] Health check failed: 16 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-11T17:19:22.151 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:21.005036+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi130-31865-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi130-31865-1"}]': finished 2024-06-11T17:19:22.151 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:21.005142+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi130-31939-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-06-11T17:19:22.151 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:21.005235+0000 mon.a [INF] from='client.? 172.21.15.130:0/1083906545' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi130-31925-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-06-11T17:19:22.151 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:21.005327+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi130-31548-1","var":"pg_num","val":"11"}]': finished 2024-06-11T17:19:22.151 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:21.043920+0000 mon.c [INF] from='client.4520 172.21.15.130:0/1747873126' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi130-31677-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-06-11T17:19:22.151 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:21.044420+0000 mon.a [INF] from='client.4520 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi130-31677-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-06-11T17:19:22.152 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:21.185896+0000 mon.c [INF] from='client.? 172.21.15.130:0/702853476' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi130-31772-7"}]: dispatch 2024-06-11T17:19:22.152 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:21.193016+0000 mon.c [INF] from='client.? 172.21.15.130:0/919365402' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi130-31798-7"}]: dispatch 2024-06-11T17:19:22.152 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:21.193645+0000 mon.b [INF] from='client.? 172.21.15.130:0/2125601430' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi130-31524-16"}]: dispatch 2024-06-11T17:19:22.152 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:21.277649+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi130-31772-7"}]: dispatch 2024-06-11T17:19:22.152 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:21.278290+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi130-31798-7"}]: dispatch 2024-06-11T17:19:22.152 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:21.280834+0000 mon.c [INF] from='client.? 172.21.15.130:0/702853476' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi130-31772-7"}]: dispatch 2024-06-11T17:19:23.104 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:21.280932+0000 mon.c [INF] from='client.? 172.21.15.130:0/919365402' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi130-31798-7"}]: dispatch 2024-06-11T17:19:23.104 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:21.308257+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi130-31524-16"}]: dispatch 2024-06-11T17:19:23.104 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:21.313022+0000 mon.b [INF] from='client.? 172.21.15.130:0/2125601430' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi130-31524-16"}]: dispatch 2024-06-11T17:19:23.104 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:21.313630+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi130-31772-7"}]: dispatch 2024-06-11T17:19:23.104 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:21.314540+0000 mon.c [INF] from='client.? 172.21.15.130:0/702853476' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi130-31772-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-06-11T17:19:23.104 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:21.314938+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi130-31798-7"}]: dispatch 2024-06-11T17:19:23.104 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:21.316313+0000 mon.c [INF] from='client.? 172.21.15.130:0/919365402' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi130-31798-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-06-11T17:19:23.104 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:21.317398+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi130-31772-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-06-11T17:19:23.104 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:21.318373+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi130-31798-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-06-11T17:19:23.104 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:21.335337+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi130-31524-16"}]: dispatch 2024-06-11T17:19:23.105 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:21.335766+0000 mon.b [INF] from='client.? 172.21.15.130:0/2125601430' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi130-31524-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-06-11T17:19:23.105 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:21.336330+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi130-31524-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-06-11T17:19:23.105 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:22.015710+0000 mon.a [INF] from='client.? 172.21.15.130:0/2909300225' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectssmithi130-32383-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi130-32383-1"}]': finished 2024-06-11T17:19:23.105 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:22.015795+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritesmithi130-32349-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi130-32349-1"}]': finished 2024-06-11T17:19:23.105 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:22.015879+0000 mon.a [INF] from='client.4520 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi130-31677-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-06-11T17:19:23.105 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:22.015967+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi130-31772-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-06-11T17:19:23.105 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:22.016008+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi130-31798-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-06-11T17:19:23.105 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:22.016045+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi130-31524-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-06-11T17:19:23.105 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:22.021229+0000 mon.c [INF] from='client.? 172.21.15.130:0/919365402' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi130-31798-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi130-31798-7"}]: dispatch 2024-06-11T17:19:23.105 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:22.021377+0000 mon.c [INF] from='client.? 172.21.15.130:0/702853476' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi130-31772-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi130-31772-7"}]: dispatch 2024-06-11T17:19:23.105 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:22.034290+0000 mon.b [INF] from='client.? 172.21.15.130:0/2125601430' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi130-31524-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi130-31524-16"}]: dispatch 2024-06-11T17:19:23.105 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:22.042433+0000 mon.b [INF] from='client.? 172.21.15.130:0/3671539236' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi130-31508-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-06-11T17:19:23.106 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:22.042917+0000 mon.b [INF] from='client.? 172.21.15.130:0/2040541692' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi130-31693-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-06-11T17:19:23.106 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:22.043247+0000 mon.b [INF] from='client.? 172.21.15.130:0/694001439' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi130-31996-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-06-11T17:19:23.106 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:22.061097+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi130-31524-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi130-31524-16"}]: dispatch 2024-06-11T17:19:23.106 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:22.061436+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi130-31798-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi130-31798-7"}]: dispatch 2024-06-11T17:19:23.106 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:22.061769+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi130-31508-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-06-11T17:19:23.106 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:22.061971+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi130-31772-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi130-31772-7"}]: dispatch 2024-06-11T17:19:24.072 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:22.062220+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi130-31693-2","app": "rados","yes_i_really_mean_it": open_pools_parallel: process_1_[32083]: starting. 2024-06-11T17:19:24.072 INFO:tasks.workunit.client.0.smithi130.stdout: open_pools_parallel: process_1_[32083]: creating pool ceph_test_rados_open_pools_parallel.smithi130-32041 2024-06-11T17:19:24.072 INFO:tasks.workunit.client.0.smithi130.stdout: open_pools_parallel: process_1_[32083]: created object 0... 2024-06-11T17:19:24.073 INFO:tasks.workunit.client.0.smithi130.stdout: open_pools_parallel: process_1_[32083]: created object 25... 2024-06-11T17:19:24.073 INFO:tasks.workunit.client.0.smithi130.stdout: open_pools_parallel: process_1_[32083]: created object 49... 2024-06-11T17:19:24.073 INFO:tasks.workunit.client.0.smithi130.stdout: open_pools_parallel: process_1_[32083]: finishing. 2024-06-11T17:19:24.073 INFO:tasks.workunit.client.0.smithi130.stdout: open_pools_parallel: process_1_[32083]: shutting down. 2024-06-11T17:19:24.073 INFO:tasks.workunit.client.0.smithi130.stdout: open_pools_parallel: process_2_[32084]: starting. 2024-06-11T17:19:24.073 INFO:tasks.workunit.client.0.smithi130.stdout: open_pools_parallel: process_2_[32084]: rados_pool_create. 2024-06-11T17:19:24.073 INFO:tasks.workunit.client.0.smithi130.stdout: open_pools_parallel: process_2_[32084]: rados_ioctx_create. 2024-06-11T17:19:24.073 INFO:tasks.workunit.client.0.smithi130.stdout: open_pools_parallel: process_2_[32084]: shutting down. 2024-06-11T17:19:24.073 INFO:tasks.workunit.client.0.smithi130.stdout: open_pools_parallel: ******************************* 2024-06-11T17:19:24.073 INFO:tasks.workunit.client.0.smithi130.stdout: open_pools_parallel: process_3_[32817]: starting. 2024-06-11T17:19:24.073 INFO:tasks.workunit.client.0.smithi130.stdout: open_pools_parallel: process_3_[32817]: creating pool ceph_test_rados_open_pools_parallel.smithi130-32041 2024-06-11T17:19:24.073 INFO:tasks.workunit.client.0.smithi130.stdout: open_pools_parallel: process_3_[32817]: created object 0... 2024-06-11T17:19:24.073 INFO:tasks.workunit.client.0.smithi130.stdout: open_pools_parallel: process_3_[32817]: created object 25... 2024-06-11T17:19:24.073 INFO:tasks.workunit.client.0.smithi130.stdout: open_pools_parallel: process_3_[32817]: created object 49... 2024-06-11T17:19:24.074 INFO:tasks.workunit.client.0.smithi130.stdout: open_pools_parallel: process_3_[32817]: finishing. 2024-06-11T17:19:24.074 INFO:tasks.workunit.client.0.smithi130.stdout: open_pools_parallel: process_3_[32817]: shutting down. 2024-06-11T17:19:24.074 INFO:tasks.workunit.client.0.smithi130.stdout: open_pools_parallel: ******************************* 2024-06-11T17:19:24.074 INFO:tasks.workunit.client.0.smithi130.stdout: open_pools_parallel: process_4_[32818]: starting. 2024-06-11T17:19:24.074 INFO:tasks.workunit.client.0.smithi130.stdout: open_pools_parallel: process_4_[32818]: rados_pool_create. 2024-06-11T17:19:24.074 INFO:tasks.workunit.client.0.smithi130.stdout: open_pools_parallel: process_4_[32818]: rados_ioctx_create. 2024-06-11T17:19:24.074 INFO:tasks.workunit.client.0.smithi130.stdout: open_pools_parallel: process_4_[32818]: shutting down. 2024-06-11T17:19:24.074 INFO:tasks.workunit.client.0.smithi130.stdout: open_pools_parallel: ******************************* 2024-06-11T17:19:24.074 INFO:tasks.workunit.client.0.smithi130.stdout: open_pools_parallel: ******************************* 2024-06-11T17:19:24.074 INFO:tasks.workunit.client.0.smithi130.stdout: open_pools_parallel: ******* SUCCESS ********** 2024-06-11T17:19:24.075 INFO:tasks.workunit.client.0.smithi130.stdout: delete_pools_parallel: process_1_[32119]: starting. 2024-06-11T17:19:24.075 INFO:tasks.workunit.client.0.smithi130.stdout: delete_pools_parallel: process_1_[32119]: creating pool ceph_test_rados_delete_pools_parallel.smithi130-32071 2024-06-11T17:19:24.075 INFO:tasks.workunit.client.0.smithi130.stdout: delete_pools_parallel: process_1_[32119]: created object 0... 2024-06-11T17:19:24.075 INFO:tasks.workunit.client.0.smithi130.stdout: delete_pools_parallel: process_1_[32119]: created object 25... 2024-06-11T17:19:24.075 INFO:tasks.workunit.client.0.smithi130.stdout: delete_pools_parallel: process_1_[32119]: created object 49... 2024-06-11T17:19:24.075 INFO:tasks.workunit.client.0.smithi130.stdout: delete_pools_parallel: process_1_[32119]: finishing. 2024-06-11T17:19:24.075 INFO:tasks.workunit.client.0.smithi130.stdout: delete_pools_parallel: process_1_[32119]: shutting down. 2024-06-11T17:19:24.075 INFO:tasks.workunit.client.0.smithi130.stdout: delete_pools_parallel: process_2_[32120]: starting. 2024-06-11T17:19:24.075 INFO:tasks.workunit.client.0.smithi130.stdout: delete_pools_parallel: process_2_[32120]: deleting pool ceph_test_rados_delete_pools_parallel.smithi130-32071 2024-06-11T17:19:24.076 INFO:tasks.workunit.client.0.smithi130.stdout: delete_pools_parallel: process_2_[32120]: shutting down. 2024-06-11T17:19:24.076 INFO:tasks.workunit.client.0.smithi130.stdout: delete_pools_parallel: ******************************* 2024-06-11T17:19:24.076 INFO:tasks.workunit.client.0.smithi130.stdout: delete_pools_parallel: process_3_[32814]: starting. 2024-06-11T17:19:24.076 INFO:tasks.workunit.client.0.smithi130.stdout: delete_pools_parallel: process_3_[32814]: creating pool ceph_test_rados_delete_pools_parallel.smithi130-32071 2024-06-11T17:19:24.076 INFO:tasks.workunit.client.0.smithi130.stdout: delete_pools_parallel: process_3_[32814]: created object 0... 2024-06-11T17:19:24.076 INFO:tasks.workunit.client.0.smithi130.stdout: delete_pools_parallel: process_3_[32814]: created object 25... 2024-06-11T17:19:24.076 INFO:tasks.workunit.client.0.smithi130.stdout: delete_pools_parallel: process_3_[32814]: created object 49... 2024-06-11T17:19:24.076 INFO:tasks.workunit.client.0.smithi130.stdout: delete_pools_parallel: process_3_[32814]: finishing. 2024-06-11T17:19:24.076 INFO:tasks.workunit.client.0.smithi130.stdout: delete_pools_parallel: process_3_[32814]: shutting down. 2024-06-11T17:19:24.076 INFO:tasks.workunit.client.0.smithi130.stdout: delete_pools_parallel: ******************************* 2024-06-11T17:19:24.076 INFO:tasks.workunit.client.0.smithi130.stdout: delete_pools_parallel: process_5_[32816]: starting. 2024-06-11T17:19:24.076 INFO:tasks.workunit.client.0.smithi130.stdout: delete_pools_parallel: process_5_[32816]: listing objects. 2024-06-11T17:19:24.076 INFO:tasks.workunit.client.0.smithi130.stdout: delete_pools_parallel: process_5_[32816]: listed object 0... 2024-06-11T17:19:24.076 INFO:tasks.workunit.client.0.smithi130.stdout: delete_pools_parallel: process_5_[32816]: listed object 25... 2024-06-11T17:19:24.076 INFO:tasks.workunit.client.0.smithi130.stdout: delete_pools_parallel: process_5_[32816]: saw 50 objects 2024-06-11T17:19:24.076 INFO:tasks.workunit.client.0.smithi130.stdout: delete_pools_parallel: process_5_[32816]: shutting down. 2024-06-11T17:19:24.077 INFO:tasks.workunit.client.0.smithi130.stdout: delete_pools_parallel: ******************************* 2024-06-11T17:19:24.077 INFO:tasks.workunit.client.0.smithi130.stdout: delete_pools_parallel: process_4_[32815]: starting. 2024-06-11T17:19:24.077 INFO:tasks.workunit.client.0.smithi130.stdout: delete_pools_parallel: process_4_[32815]: deleting pool ceph_test_rados_delete_pools_parallel.smithi130-32071 2024-06-11T17:19:24.077 INFO:tasks.workunit.client.0.smithi130.stdout: delete_pools_parallel: process_4_[32815]: shutting down. 2024-06-11T17:19:24.077 INFO:tasks.workunit.client.0.smithi130.stdout: delete_pools_parallel: ******************************* 2024-06-11T17:19:24.077 INFO:tasks.workunit.client.0.smithi130.stdout: delete_pools_parallel: ******************************* 2024-06-11T17:19:24.077 INFO:tasks.workunit.client.0.smithi130.stdout: delete_pools_parallel: ******* SUCCESS ********** 2024-06-11T17:19:24.077 INFO:tasks.workunit.client.0.smithi130.stdout: cls: Running main() from gmock_main.cc 2024-06-11T17:19:24.077 INFO:tasks.workunit.client.0.smithi130.stdout: cls: [==========] Running 2 tests from 1 test suite. 2024-06-11T17:19:24.078 INFO:tasks.workunit.client.0.smithi130.stdout: cls: [----------] Global test environment set-up. 2024-06-11T17:19:24.078 INFO:tasks.workunit.client.0.smithi130.stdout: cls: [----------] 2 tests from NeoRadosCls 2024-06-11T17:19:24.078 INFO:tasks.workunit.client.0.smithi130.stdout: cls: [ RUN ] NeoRadosCls.DNE 2024-06-11T17:19:24.078 INFO:tasks.workunit.client.0.smithi130.stdout: cls: [ OK ] NeoRadosCls.DNE (2191 ms) 2024-06-11T17:19:24.078 INFO:tasks.workunit.client.0.smithi130.stdout: cls: [ RUN ] NeoRadosCls.RemoteReads 2024-06-11T17:19:24.078 INFO:tasks.workunit.client.0.smithi130.stdout: cls: unknown file: Failure 2024-06-11T17:19:24.078 INFO:tasks.workunit.client.0.smithi130.stdout: cls: C++ exception with description "(95) Operation not supported [osd:95]" thrown in the test body. 2024-06-11T17:19:24.078 INFO:tasks.workunit.client.0.smithi130.stdout: cls: [ FAILED ] NeoRadosCls.RemoteReads (3042 ms) 2024-06-11T17:19:24.078 INFO:tasks.workunit.client.0.smithi130.stdout: cls: [----------] 2 tests from NeoRadosCls (5233 ms total) 2024-06-11T17:19:24.078 INFO:tasks.workunit.client.0.smithi130.stdout: cls: 2024-06-11T17:19:24.078 INFO:tasks.workunit.client.0.smithi130.stdout: cls: [----------] Global test environment tear-down 2024-06-11T17:19:24.078 INFO:tasks.workunit.client.0.smithi130.stdout: cls: [==========] 2 tests from 1 test suite ran. (5234 ms total) 2024-06-11T17:19:24.078 INFO:tasks.workunit.client.0.smithi130.stdout: cls: [ PASSED ] 1 test. 2024-06-11T17:19:24.078 INFO:tasks.workunit.client.0.smithi130.stdout: cls: [ FAILED ] 1 test, listed below: 2024-06-11T17:19:24.079 INFO:tasks.workunit.client.0.smithi130.stdout: cls: [ FAILED ] NeoRadosCls.RemoteReads 2024-06-11T17:19:24.079 INFO:tasks.workunit.client.0.smithi130.stdout: cls: 2024-06-11T17:19:24.079 INFO:tasks.workunit.client.0.smithi130.stdout: cls: 1 FAILED TEST 2024-06-11T17:19:25.117 INFO:tasks.workunit.client.0.smithi130.stdout: cmd: Running main() from gmock_main.cc 2024-06-11T17:19:25.117 INFO:tasks.workunit.client.0.smithi130.stdout: cmd: [==========] Running 3 tests from 1 test suite. 2024-06-11T17:19:25.117 INFO:tasks.workunit.client.0.smithi130.stdout: cmd: [----------] Global test environment set-up. 2024-06-11T17:19:25.117 INFO:tasks.workunit.client.0.smithi130.stdout: cmd: [----------] 3 tests from NeoRadosCmd 2024-06-11T17:19:25.117 INFO:tasks.workunit.client.0.smithi130.stdout: cmd: [ RUN ] NeoRadosCmd.MonDescribe 2024-06-11T17:19:25.118 INFO:tasks.workunit.client.0.smithi130.stdout: cmd: [ OK ] NeoRadosCmd.MonDescribe (1170 ms) 2024-06-11T17:19:25.118 INFO:tasks.workunit.client.0.smithi130.stdout: cmd: [ RUN ] NeoRadosCmd.OSDCmd 2024-06-11T17:19:25.118 INFO:tasks.workunit.client.0.smithi130.stdout: cmd: [ OK ] NeoRadosCmd.OSDCmd (2005 ms) 2024-06-11T17:19:25.118 INFO:tasks.workunit.client.0.smithi130.stdout: cmd: [ RUN ] NeoRadosCmd.PGCmd 2024-06-11T17:19:25.118 INFO:tasks.workunit.client.0.smithi130.stdout: cmd: [ OK ] NeoRadosCmd.PGCmd (3084 ms) 2024-06-11T17:19:25.118 INFO:tasks.workunit.client.0.smithi130.stdout: cmd: [----------] 3 tests from NeoRadosCmd (6259 ms total) 2024-06-11T17:19:25.118 INFO:tasks.workunit.client.0.smithi130.stdout: cmd: 2024-06-11T17:19:25.118 INFO:tasks.workunit.client.0.smithi130.stdout: cmd: [----------] Global test environment tear-down 2024-06-11T17:19:25.118 INFO:tasks.workunit.client.0.smithi130.stdout: cmd: [==========] 3 tests from 1 test suite ran. (6259 ms total) 2024-06-11T17:19:25.118 INFO:tasks.workunit.client.0.smithi130.stdout: cmd: [ PASSED ] 3 tests. 2024-06-11T17:19:26.131 INFO:tasks.workunit.client.0.smithi130.stdout: true}]: dispatch 2024-06-11T17:19:26.131 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:22.065227+0000 mon.c [INF] from='client.? 172.21.15.130:0/3722473182' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi130-31516-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-06-11T17:19:26.131 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:22.090600+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi130-31996-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-06-11T17:19:26.131 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:22.091328+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi130-31516-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-06-11T17:19:26.131 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:22.150508+0000 mon.c [INF] from='client.? 172.21.15.130:0/3470714427' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-06-11T17:19:26.131 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:22.151449+0000 client.admin [INF] onexx 2024-06-11T17:19:26.131 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:22.153714+0000 mon.c [INF] from='client.? 172.21.15.130:0/4092161308' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi130-31531-24"}]: dispatch 2024-06-11T17:19:26.131 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:22.169031+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-06-11T17:19:26.132 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:22.169370+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi130-31531-24"}]: dispatch 2024-06-11T17:19:26.132 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:22.170860+0000 mon.c [INF] from='client.? 172.21.15.130:0/4092161308' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi130-31531-24"}]: dispatch 2024-06-11T17:19:26.132 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:22.196581+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi130-31531-24"}]: dispatch 2024-06-11T17:19:26.132 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:22.197653+0000 mon.c [INF] from='client.? 172.21.15.130:0/4092161308' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi130-31531-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-06-11T17:19:26.132 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:22.201029+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi130-31531-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-06-11T17:19:26.132 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:24.097158+0000 mon.c [INF] from='client.? 172.21.15.130:0/3722473182' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi130-31516-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-06-11T17:19:26.132 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:24.101831+0000 mon.c [INF] from='client.4520 172.21.15.130:0/1747873126' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi130-31677-4", "tierpool": "test-rados-api-smithi130-31677-4-cache"}]: dispatch 2024-06-11T17:19:26.132 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:24.103684+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi130-31516-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-06-11T17:19:26.132 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:24.104233+0000 mon.a [INF] from='client.4520 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi130-31677-4", "tierpool": "test-rados-api-smithi130-31677-4-cache"}]: dispatch 2024-06-11T17:19:26.132 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:24.105780+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-06-11T17:19:26.143 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:25.050191+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi130-31531-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi130-31531-24"}]': finished 2024-06-11T17:19:26.143 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:25.050501+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi130-32349-1"}]': finished 2024-06-11T17:19:26.143 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:25.050671+0000 mon.a [INF] from='client.? 172.21.15.130:0/2909300225' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi130-32383-1"}]': finished 2024-06-11T17:19:26.143 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:25.050807+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi130-31865-1"}]': finished 2024-06-11T17:19:26.143 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:25.050993+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi130-31516-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-06-11T17:19:26.143 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:25.051192+0000 mon.a [INF] from='client.4520 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi130-31677-4", "tierpool": "test-rados-api-smithi130-31677-4-cache"}]': finished 2024-06-11T17:19:26.143 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:25.076181+0000 mon.c [INF] from='client.4520 172.21.15.130:0/1747873126' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi130-31677-4", "overlaypool": "test-rados-api-smithi130-31677-4-cache"}]: dispatch 2024-06-11T17:19:26.143 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:25.080136+0000 mon.a [INF] from='client.? 172.21.15.130:0/2909300225' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi130-32383-1"}]: dispatch 2024-06-11T17:19:26.143 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:25.081100+0000 mon.a [INF] from='client.4520 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi130-31677-4", "overlaypool": "test-rados-api-smithi130-31677-4-cache"}]: dispatch 2024-06-11T17:19:26.143 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:25.091360+0000 mon.b [INF] from='client.? 172.21.15.130:0/1915527913' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi130-31693-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-06-11T17:19:26.143 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:25.094851+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi130-31693-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-06-11T17:19:26.144 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:25.095349+0000 mon.b [INF] from='client.? 172.21.15.130:0/1175735298' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi130-31996-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-06-11T17:19:26.144 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:25.100884+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi130-31996-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-06-11T17:19:26.144 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:25.121807+0000 mon.c [INF] from='client.? 172.21.15.130:0/3722473182' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi130-31516-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-06-11T17:19:26.144 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:25.122992+0000 mon.c [INF] from='client.? 172.21.15.130:0/3213981203' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi130-31508-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-06-11T17:19:26.144 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:25.159209+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi130-31516-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-06-11T17:19:26.144 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:25.159642+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi130-31508-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-06-11T17:19:26.144 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:25.187808+0000 mon.a [INF] from='client.? 172.21.15.130:0/2380466153' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi130-32349-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-06-11T17:19:26.144 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:25.352416+0000 mon.b [INF] from='client.? 172.21.15.130:0/2346672204' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.0"}]: dispatch 2024-06-11T17:19:26.144 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:25.353530+0000 mon.b [INF] from='client.? 172.21.15.130:0/2346672204' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.1"}]: dispatch 2024-06-11T17:19:26.144 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:25.354514+0000 mon.b [INF] from='client.? 172.21.15.130:0/2346672204' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.2"}]: dispatch 2024-06-11T17:19:26.144 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:25.355460+0000 mon.b [INF] from='client.? 172.21.15.130:0/2346672204' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.3"}]: dispatch 2024-06-11T17:19:26.144 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:25.356265+0000 mon.b [INF] from='client.? 172.21.15.130:0/2346672204' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.4"}]: dispatch 2024-06-11T17:19:26.144 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:25.357115+0000 mon.b [INF] from='client.? 172.21.15.130:0/2346672204' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.5"}]: dispatch 2024-06-11T17:19:26.145 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:25.358047+0000 mon.b [INF] from='client.? 172.21.15.130:0/2346672204' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.6"}]: dispatch 2024-06-11T17:19:26.145 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:25.358862+0000 mon.b [INF] from='client.? 172.21.15.130:0/2346672204' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.7"}]: dispatch 2024-06-11T17:19:26.145 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:25.359712+0000 mon.b [INF] from='client.? 172.21.15.130:0/2346672204' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.8"}]: dispatch 2024-06-11T17:19:26.145 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:25.360399+0000 mon.b [INF] from='client.? 172.21.15.130:0/2346672204' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.9"}]: dispatch 2024-06-11T17:19:26.145 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.061624+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi130-31556-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi130-31556-10"}]': finished 2024-06-11T17:19:26.145 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.061816+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi130-31562-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi130-31562-10"}]': finished 2024-06-11T17:19:26.145 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.061970+0000 mon.a [INF] from='client.? 172.21.15.130:0/2909300225' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi130-32383-1"}]': finished 2024-06-11T17:19:26.145 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.062082+0000 mon.a [INF] from='client.4520 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi130-31677-4", "overlaypool": "test-rados-api-smithi130-31677-4-cache"}]': finished 2024-06-11T17:19:26.145 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.062217+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi130-31693-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-06-11T17:19:26.266 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06- api_io_pp: Running main() from gmock_main.cc 2024-06-11T17:19:26.266 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [==========] Running 40 tests from 2 test suites. 2024-06-11T17:19:26.266 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [----------] Global test environment set-up. 2024-06-11T17:19:26.266 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [----------] 22 tests from LibRadosIoPP 2024-06-11T17:19:26.266 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: seed 31531 2024-06-11T17:19:26.266 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2024-06-11T17:19:26.266 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2024-06-11T17:19:26.266 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2024-06-11T17:19:26.266 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (270 ms) 2024-06-11T17:19:26.266 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2024-06-11T17:19:26.266 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (14 ms) 2024-06-11T17:19:26.266 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2024-06-11T17:19:26.266 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (6 ms) 2024-06-11T17:19:26.267 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadExtentArrayOpPP 2024-06-11T17:19:26.267 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadExtentArrayOpPP (667 ms) 2024-06-11T17:19:26.267 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2024-06-11T17:19:26.267 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (4 ms) 2024-06-11T17:19:26.267 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2024-06-11T17:19:26.267 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (3 ms) 2024-06-11T17:19:26.267 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2024-06-11T17:19:26.267 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (3 ms) 2024-06-11T17:19:26.267 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2024-06-11T17:19:26.267 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (4 ms) 2024-06-11T17:19:26.267 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2024-06-11T17:19:26.267 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (6 ms) 2024-06-11T17:19:26.267 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2024-06-11T17:19:26.267 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (4 ms) 2024-06-11T17:19:26.267 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2024-06-11T17:19:26.268 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (7 ms) 2024-06-11T17:19:26.268 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2024-06-11T17:19:26.268 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (10 ms) 2024-06-11T17:19:26.268 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2024-06-11T17:19:26.268 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (73 ms) 2024-06-11T17:19:26.268 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2024-06-11T17:19:26.268 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (164 ms) 2024-06-11T17:19:26.268 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2024-06-11T17:19:26.268 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (11 ms) 2024-06-11T17:19:26.268 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2024-06-11T17:19:26.268 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (59 ms) 2024-06-11T17:19:26.268 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2024-06-11T17:19:26.268 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (12 ms) 2024-06-11T17:19:26.269 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CrcZeroWrite 2024-06-11T17:19:26.269 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoPP.CrcZeroWrite (8 ms) 2024-06-11T17:19:26.269 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2024-06-11T17:19:26.269 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (8 ms) 2024-06-11T17:19:26.269 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2024-06-11T17:19:26.269 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (3 ms) 2024-06-11T17:19:26.269 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2024-06-11T17:19:26.269 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (5 ms) 2024-06-11T17:19:26.269 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [----------] 22 tests from LibRadosIoPP (1342 ms total) 2024-06-11T17:19:26.269 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: 2024-06-11T17:19:26.269 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [----------] 18 tests from LibRadosIoECPP 2024-06-11T17:19:26.269 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2024-06-11T17:19:26.269 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SimpleWritePP (1129 ms) 2024-06-11T17:19:26.269 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2024-06-11T17:19:26.269 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoECPP.ReadOpPP (18 ms) 2024-06-11T17:19:26.269 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2024-06-11T17:19:26.270 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SparseReadOpPP (4 ms) 2024-06-11T17:19:27.140 INFO:tasks.workunit.client.0.smithi130.stdout: 11T17:19:26.062373+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi130-31996-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-06-11T17:19:27.140 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.062563+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi130-31516-3", "field": "max_bytes", "val": "4096"}]': finished 2024-06-11T17:19:27.140 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.062798+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi130-31508-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-06-11T17:19:27.140 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.063095+0000 mon.a [INF] from='client.? 172.21.15.130:0/2380466153' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi130-32349-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-06-11T17:19:27.141 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.074161+0000 mon.c [INF] from='client.4520 172.21.15.130:0/1747873126' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi130-31677-4-cache", "mode": "writeback"}]: dispatch 2024-06-11T17:19:27.141 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.077532+0000 mon.c [INF] from='client.? 172.21.15.130:0/702853476' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi130-31772-7"}]: dispatch 2024-06-11T17:19:27.141 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.080297+0000 mon.c [INF] from='client.? 172.21.15.130:0/919365402' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi130-31798-7"}]: dispatch 2024-06-11T17:19:27.141 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.084331+0000 mon.a [INF] from='client.? 172.21.15.130:0/2380466153' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi130-32349-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi130-32349-2"}]: dispatch 2024-06-11T17:19:27.141 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.085392+0000 mon.a [INF] from='client.4520 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi130-31677-4-cache", "mode": "writeback"}]: dispatch 2024-06-11T17:19:27.141 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.086390+0000 mon.b [INF] from='client.? 172.21.15.130:0/355147928' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi130-31865-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-06-11T17:19:27.141 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.098459+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi130-31772-7"}]: dispatch 2024-06-11T17:19:27.141 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.108833+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi130-31798-7"}]: dispatch 2024-06-11T17:19:27.141 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.110006+0000 mon.a [INF] from='client.4726 172.21.15.130:0/2125601430' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi130-31524-16"}]: dispatch 2024-06-11T17:19:27.141 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.110455+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi130-31865-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-06-11T17:19:27.141 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.133861+0000 mon.b [INF] from='client.4682 172.21.15.130:0/3470714427' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-06-11T17:19:27.141 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.134735+0000 client.admin [INF] threexx 2024-06-11T17:19:27.142 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.140970+0000 mon.a [INF] from='client.4682 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-06-11T17:19:27.142 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.226150+0000 mon.c [INF] from='client.? 172.21.15.130:0/744298232' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi130-32383-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-06-11T17:19:27.142 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.226530+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi130-32383-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-06-11T17:19:27.142 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.329428+0000 mon.c [INF] from='client.? 172.21.15.130:0/4092161308' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "LibRadosIoECPP_smithi130-31531-24", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-06-11T17:19:27.142 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.329899+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "LibRadosIoECPP_smithi130-31531-24", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-06-11T17:19:27.142 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.848214+0000 mon.a [WRN] Health check update: 15 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-11T17:19:27.142 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.852543+0000 mon.a [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-06-11T17:19:27.142 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.856533+0000 mon.a [INF] from='client.4520 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi130-31677-4-cache", "mode": "writeback"}]': finished 2024-06-11T17:19:27.142 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.856704+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi130-31772-7"}]': finished 2024-06-11T17:19:27.142 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.856821+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi130-31798-7"}]': finished 2024-06-11T17:19:27.142 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.856929+0000 mon.a [INF] from='client.4726 172.21.15.130:0/2125601430' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi130-31524-16"}]': finished 2024-06-11T17:19:27.142 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.857022+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi130-31865-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-06-11T17:19:27.142 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.857146+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi130-32383-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-06-11T17:19:27.143 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.857272+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "LibRadosIoECPP_smithi130-31531-24", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-06-11T17:19:27.143 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.868874+0000 mon.c [INF] from='client.? 172.21.15.130:0/919365402' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi130-31798-7"}]: dispatch 2024-06-11T17:19:27.143 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.869589+0000 mon.c [INF] from='client.? 172.21.15.130:0/744298232' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi130-32383-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi130-32383-2"}]: dispatch 2024-06-11T17:19:27.885 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.870038+0000 mon.c [INF] from='client.? 172.21.15.130:0/702853476' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi api_stat: Running main() from gmock_main.cc 2024-06-11T17:19:27.885 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat: [==========] Running 9 tests from 2 test suites. 2024-06-11T17:19:27.885 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat: [----------] Global test environment set-up. 2024-06-11T17:19:27.885 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat: [----------] 5 tests from LibRadosStat 2024-06-11T17:19:27.885 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2024-06-11T17:19:27.885 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat: [ OK ] LibRadosStat.Stat (236 ms) 2024-06-11T17:19:27.886 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat: [ RUN ] LibRadosStat.Stat2 2024-06-11T17:19:27.886 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat: [ OK ] LibRadosStat.Stat2 (26 ms) 2024-06-11T17:19:27.886 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2024-06-11T17:19:27.886 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat: [ OK ] LibRadosStat.StatNS (15 ms) 2024-06-11T17:19:27.886 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2024-06-11T17:19:27.886 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (0 ms) 2024-06-11T17:19:27.886 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2024-06-11T17:19:27.886 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (3 ms) 2024-06-11T17:19:27.886 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat: [----------] 5 tests from LibRadosStat (280 ms total) 2024-06-11T17:19:27.886 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat: 2024-06-11T17:19:27.886 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2024-06-11T17:19:27.886 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2024-06-11T17:19:27.886 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat: [ OK ] LibRadosStatEC.Stat (1108 ms) 2024-06-11T17:19:27.887 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2024-06-11T17:19:27.887 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat: [ OK ] LibRadosStatEC.StatNS (36 ms) 2024-06-11T17:19:27.887 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2024-06-11T17:19:27.887 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat: [ OK ] LibRadosStatEC.ClusterStat (0 ms) 2024-06-11T17:19:27.887 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2024-06-11T17:19:27.887 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat: [ OK ] LibRadosStatEC.PoolStat (11 ms) 2024-06-11T17:19:27.887 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (1155 ms total) 2024-06-11T17:19:27.887 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat: 2024-06-11T17:19:27.887 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat: [----------] Global test environment tear-down 2024-06-11T17:19:27.887 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat: [==========] 9 tests from 2 test suites ran. (9183 ms total) 2024-06-11T17:19:27.887 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat: [ PASSED ] 9 tests. 2024-06-11T17:19:27.913 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: Running main() from gmock_main.cc 2024-06-11T17:19:27.913 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [==========] Running 24 tests from 2 test suites. 2024-06-11T17:19:27.914 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [----------] Global test environment set-up. 2024-06-11T17:19:27.914 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [----------] 14 tests from LibRadosIo 2024-06-11T17:19:27.914 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2024-06-11T17:19:27.914 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (248 ms) 2024-06-11T17:19:27.914 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2024-06-11T17:19:27.914 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2024-06-11T17:19:27.914 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2024-06-11T17:19:27.914 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: no timeout :/ 2024-06-11T17:19:27.914 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: no timeout :/ 2024-06-11T17:19:27.914 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: no timeout :/ 2024-06-11T17:19:27.914 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: no timeout :/ 2024-06-11T17:19:27.914 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: no timeout :/ 2024-06-11T17:19:27.915 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (54 ms) 2024-06-11T17:19:27.915 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2024-06-11T17:19:27.915 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (12 ms) 2024-06-11T17:19:27.915 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2024-06-11T17:19:27.915 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ OK ] LibRadosIo.Checksum (5 ms) 2024-06-11T17:19:27.915 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2024-06-11T17:19:27.915 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (7 ms) 2024-06-11T17:19:27.915 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2024-06-11T17:19:27.915 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (5 ms) 2024-06-11T17:19:27.915 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2024-06-11T17:19:27.915 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (14 ms) 2024-06-11T17:19:27.916 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ RUN ] LibRadosIo.ZeroLenZero 2024-06-11T17:19:27.916 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ OK ] LibRadosIo.ZeroLenZero (4 ms) 2024-06-11T17:19:27.916 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2024-06-11T17:19:27.916 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ OK ] LibRadosIo.TruncTest (8 ms) 2024-06-11T17:19:27.916 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2024-06-11T17:19:27.916 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (6 ms) 2024-06-11T17:19:27.916 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2024-06-11T17:19:27.916 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (7 ms) 2024-06-11T17:19:27.916 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2024-06-11T17:19:27.916 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ OK ] LibRadosIo.RmXattr (27 ms) 2024-06-11T17:19:27.916 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2024-06-11T17:19:27.916 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ OK ] LibRadosIo.XattrIter (14 ms) 2024-06-11T17:19:27.916 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [----------] 14 tests from LibRadosIo (411 ms total) 2024-06-11T17:19:27.916 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: 2024-06-11T17:19:27.917 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2024-06-11T17:19:27.917 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2024-06-11T17:19:27.917 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ OK ] LibRadosIoEC.SimpleWrite (1176 ms) 2024-06-11T17:19:27.917 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2024-06-11T17:19:27.917 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ OK ] LibRadosIoEC.RoundTrip (7 ms) 2024-06-11T17:19:27.917 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-06-11T17:19:27.917 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ OK ] LibRadosIoEC.OverlappingWriteRoundTrip (13 ms) 2024-06-11T17:19:27.917 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2024-06-11T17:19:27.917 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ OK ] LibRadosIoEC.WriteFullRoundTrip (12 ms) 2024-06-11T17:19:27.917 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2024-06-11T17:19:27.917 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ OK ] LibRadosIoEC.AppendRoundTrip (15 ms) 2024-06-11T17:19:27.917 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2024-06-11T17:19:27.917 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ OK ] LibRadosIoEC.TruncTest (5 ms) 2024-06-11T17:19:27.917 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2024-06-11T17:19:27.918 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ OK ] LibRadosIoEC.RemoveTest (4 ms) 2024-06-11T17:19:27.918 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2024-06-11T17:19:27.918 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ OK ] LibRadosIoEC.XattrsRoundTrip (5 ms) 2024-06-11T17:19:27.918 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2024-06-11T17:19:27.918 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ OK ] LibRadosIoEC.RmXattr (14 ms) 2024-06-11T17:19:27.918 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2024-06-11T17:19:27.918 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ OK ] LibRadosIoEC.XattrIter (8 ms) 2024-06-11T17:19:27.918 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [----------] 10 tests from LibRadosIoEC (1259 ms total) 2024-06-11T17:19:27.918 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: 2024-06-11T17:19:27.918 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [----------] Global test environment tear-down 2024-06-11T17:19:27.918 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [==========] 24 tests from 2 test suites ran. (9321 ms total) 2024-06-11T17:19:27.918 INFO:tasks.workunit.client.0.smithi130.stdout: api_io: [ PASSED ] 24 tests. 2024-06-11T17:19:27.919 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat_pp: Running main() from gmock_main.cc 2024-06-11T17:19:27.919 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2024-06-11T17:19:27.919 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat_pp: [----------] Global test environment set-up. 2024-06-11T17:19:27.919 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2024-06-11T17:19:27.919 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat_pp: seed 31798 2024-06-11T17:19:27.919 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2024-06-11T17:19:27.919 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (241 ms) 2024-06-11T17:19:27.919 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2024-06-11T17:19:27.919 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (10 ms) 2024-06-11T17:19:27.919 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2024-06-11T17:19:27.919 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (0 ms) 2024-06-11T17:19:27.919 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2024-06-11T17:19:27.920 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (11 ms) 2024-06-11T17:19:27.920 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2024-06-11T17:19:27.920 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (24 ms) 2024-06-11T17:19:27.920 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (286 ms total) 2024-06-11T17:19:27.920 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat_pp: 2024-06-11T17:19:27.920 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2024-06-11T17:19:27.920 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2024-06-11T17:19:27.920 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPP (1143 ms) 2024-06-11T17:19:27.920 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2024-06-11T17:19:27.920 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.ClusterStatPP (0 ms) 2024-06-11T17:19:27.920 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2024-06-11T17:19:27.920 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.PoolStatPP (13 ms) 2024-06-11T17:19:27.920 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2024-06-11T17:19:27.920 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPPNS (11 ms) 2024-06-11T17:19:27.921 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (1167 ms total) 2024-06-11T17:19:27.921 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat_pp: 2024-06-11T17:19:27.921 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat_pp: [----------] Global test environment tear-down 2024-06-11T17:19:27.921 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (9180 ms total) 2024-06-11T17:19:27.921 INFO:tasks.workunit.client.0.smithi130.stdout: api_stat_pp: [ PASSED ] 9 tests. 2024-06-11T17:19:28.896 INFO:tasks.workunit.client.0.smithi130.stdout: list: Running main() from gmock_main.cc 2024-06-11T17:19:28.896 INFO:tasks.workunit.client.0.smithi130.stdout: list: [==========] Running 3 tests from 1 test suite. 2024-06-11T17:19:28.896 INFO:tasks.workunit.client.0.smithi130.stdout: list: [----------] Global test environment set-up. 2024-06-11T17:19:28.896 INFO:tasks.workunit.client.0.smithi130.stdout: list: [----------] 3 tests from NeoradosList 2024-06-11T17:19:28.896 INFO:tasks.workunit.client.0.smithi130.stdout: list: [ RUN ] NeoradosList.ListObjects 2024-06-11T17:19:28.896 INFO:tasks.workunit.client.0.smithi130.stdout: list: [ OK ] NeoradosList.ListObjects (3104 ms) 2024-06-11T17:19:28.896 INFO:tasks.workunit.client.0.smithi130.stdout: list: [ RUN ] NeoradosList.ListObjectsNS 2024-06-11T17:19:28.896 INFO:tasks.workunit.client.0.smithi130.stdout: list: [ OK ] NeoradosList.ListObjectsNS (3069 ms) 2024-06-11T17:19:28.896 INFO:tasks.workunit.client.0.smithi130.stdout: list: [ RUN ] NeoradosList.ListObjectsMany 2024-06-11T17:19:28.896 INFO:tasks.workunit.client.0.smithi130.stdout: list: [ OK ] NeoradosList.ListObjectsMany (3783 ms) 2024-06-11T17:19:28.896 INFO:tasks.workunit.client.0.smithi130.stdout: list: [----------] 3 tests from NeoradosList (9956 ms total) 2024-06-11T17:19:28.897 INFO:tasks.workunit.client.0.smithi130.stdout: list: 2024-06-11T17:19:28.897 INFO:tasks.workunit.client.0.smithi130.stdout: list: [----------] Global test environment tear-down 2024-06-11T17:19:28.897 INFO:tasks.workunit.client.0.smithi130.stdout: list: [==========] 3 tests from 1 test suite ran. (9956 ms total) 2024-06-11T17:19:28.897 INFO:tasks.workunit.client.0.smithi130.stdout: list: [ PASSED ] 3 tests. 2024-06-11T17:19:28.933 INFO:tasks.workunit.client.0.smithi130.stdout: watch_notify: Running main() from gmock_main.cc 2024-06-11T17:19:28.933 INFO:tasks.workunit.client.0.smithi130.stdout: watch_notify: [==========] Running 2 tests from 1 test suite. 2024-06-11T17:19:28.933 INFO:tasks.workunit.client.0.smithi130.stdout: watch_notify: [----------] Global test environment set-up. 2024-06-11T17:19:28.933 INFO:tasks.workunit.client.0.smithi130.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify 2024-06-11T17:19:28.933 INFO:tasks.workunit.client.0.smithi130.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotify 2024-06-11T17:19:28.933 INFO:tasks.workunit.client.0.smithi130.stdout: watch_notify: handle_notify cookie 94447123582704 notify_id 85899345921 notifier_gid 4614 2024-06-11T17:19:28.933 INFO:tasks.workunit.client.0.smithi130.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotify (3079 ms) 2024-06-11T17:19:28.933 INFO:tasks.workunit.client.0.smithi130.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2024-06-11T17:19:28.933 INFO:tasks.workunit.client.0.smithi130.stdout: watch_notify: Trying... 2024-06-11T17:19:28.933 INFO:tasks.workunit.client.0.smithi130.stdout: watch_notify: handle_notify cookie 94447135818512 notify_id 98784247809 notifier_gid 4673 2024-06-11T17:19:28.933 INFO:tasks.workunit.client.0.smithi130.stdout: watch_notify: Waiting for 3.000000000s 2024-06-11T17:19:28.933 INFO:tasks.workunit.client.0.smithi130.stdout: watch_notify: Timed out. 2024-06-11T17:19:28.933 INFO:tasks.workunit.client.0.smithi130.stdout: watch_notify: Flushing... 2024-06-11T17:19:28.934 INFO:tasks.workunit.client.0.smithi130.stdout: watch_notify: Flushed... 2024-06-11T17:19:28.934 INFO:tasks.workunit.client.0.smithi130.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (6852 ms) 2024-06-11T17:19:28.934 INFO:tasks.workunit.client.0.smithi130.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify (9931 ms total) 2024-06-11T17:19:28.934 INFO:tasks.workunit.client.0.smithi130.stdout: watch_notify: 2024-06-11T17:19:28.934 INFO:tasks.workunit.client.0.smithi130.stdout: watch_notify: [----------] Global test environment tear-down 2024-06-11T17:19:28.934 INFO:tasks.workunit.client.0.smithi130.stdout: watch_notify: [==========] 2 tests from 1 test suite ran. (9931 ms total) 2024-06-11T17:19:28.934 INFO:tasks.workunit.client.0.smithi130.stdout: watch_notify: [ PASSED ] 2 tests. 2024-06-11T17:19:29.910 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2024-06-11T17:19:29.910 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP (4 ms) 2024-06-11T17:19:29.910 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2024-06-11T17:19:29.910 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP2 (4 ms) 2024-06-11T17:19:29.910 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-06-11T17:19:29.910 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoECPP.OverlappingWriteRoundTripPP (6 ms) 2024-06-11T17:19:29.910 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2024-06-11T17:19:29.910 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP (5 ms) 2024-06-11T17:19:29.910 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-06-11T17:19:29.910 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP2 (6 ms) 2024-06-11T17:19:29.910 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2024-06-11T17:19:29.911 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoECPP.AppendRoundTripPP (5 ms) 2024-06-11T17:19:29.911 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2024-06-11T17:19:29.911 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoECPP.TruncTestPP (6 ms) 2024-06-11T17:19:29.911 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2024-06-11T17:19:29.911 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RemoveTestPP (4 ms) 2024-06-11T17:19:29.911 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2024-06-11T17:19:29.911 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrsRoundTripPP (3 ms) 2024-06-11T17:19:29.911 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2024-06-11T17:19:29.911 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RmXattrPP (14 ms) 2024-06-11T17:19:29.911 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CrcZeroWrite 2024-06-11T17:19:29.911 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: ./src/test/librados/io_cxx.cc:888: Failure 2024-06-11T17:19:29.911 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: Expected equality of these values: 2024-06-11T17:19:29.911 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: 0 2024-06-11T17:19:29.911 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: ioctx.write("foo", bl, 0, sizeof(buf)) 2024-06-11T17:19:29.911 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: Which is: -95 2024-06-11T17:19:29.911 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ FAILED ] LibRadosIoECPP.CrcZeroWrite (656 ms) 2024-06-11T17:19:29.912 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2024-06-11T17:19:29.912 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrListPP (50 ms) 2024-06-11T17:19:29.912 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2024-06-11T17:19:29.912 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: ./src/test/librados/testcase_cxx.cc:392: Failure 2024-06-11T17:19:29.912 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: Value of: req 2024-06-11T17:19:29.912 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: Actual: false 2024-06-11T17:19:29.912 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: Expected: true 2024-06-11T17:19:29.912 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ FAILED ] LibRadosIoECPP.CmpExtPP (0 ms) 2024-06-11T17:19:29.912 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2024-06-11T17:19:29.912 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: ./src/test/librados/testcase_cxx.cc:392: Failure 2024-06-11T17:19:29.912 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: Value of: req 2024-06-11T17:19:29.912 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: Actual: false 2024-06-11T17:19:29.912 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: Expected: true 2024-06-11T17:19:29.912 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ FAILED ] LibRadosIoECPP.CmpExtDNEPP (0 ms) 2024-06-11T17:19:29.913 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2024-06-11T17:19:29.913 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: ./src/test/librados/testcase_cxx.cc:392: Failure 2024-06-11T17:19:29.913 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: Value of: req 2024-06-11T17:19:29.913 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: Actual: false 2024-06-11T17:19:29.913 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: Expected: true 2024-06-11T17:19:29.913 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ FAILED ] LibRadosIoECPP.CmpExtMismatchPP (0 ms) 2024-06-11T17:19:29.913 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [----------] 18 tests from LibRadosIoECPP (1915 ms total) 2024-06-11T17:19:29.913 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: 2024-06-11T17:19:29.913 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [----------] Global test environment tear-down 2024-06-11T17:19:29.913 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [==========] 40 tests from 2 test suites ran. (11307 ms total) 2024-06-11T17:19:29.913 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ PASSED ] 36 tests. 2024-06-11T17:19:29.913 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ FAILED ] 4 tests, listed below: 2024-06-11T17:19:29.913 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ FAILED ] LibRadosIoECPP.CrcZeroWrite 2024-06-11T17:19:29.913 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ FAILED ] LibRadosIoECPP.CmpExtPP 2024-06-11T17:19:29.913 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ FAILED ] LibRadosIoECPP.CmpExtDNEPP 2024-06-11T17:19:29.914 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: [ FAILED ] LibRadosIoECPP.CmpExtMismatchPP 2024-06-11T17:19:29.914 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: 2024-06-11T17:19:29.914 INFO:tasks.workunit.client.0.smithi130.stdout: api_io_pp: 4 FAILED TESTS 2024-06-11T17:19:30.155 INFO:tasks.workunit.client.0.smithi130.stdout:130-31772-7"}]: dispatch 2024-06-11T17:19:30.155 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.883815+0000 mon.a [INF] from='client.4726 172.21.15.130:0/2125601430' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi130-31524-16"}]: dispatch 2024-06-11T17:19:30.155 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.884488+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi130-31798-7"}]: dispatch 2024-06-11T17:19:30.155 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.884984+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi130-32383-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi130-32383-2"}]: dispatch 2024-06-11T17:19:30.156 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:26.885404+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi130-31772-7"}]: dispatch 2024-06-11T17:19:30.156 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:27.024802+0000 mon.b [INF] from='client.? 172.21.15.130:0/355147928' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi130-31865-6", "pg_num": 4}]: dispatch 2024-06-11T17:19:30.156 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:27.030973+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi130-31865-6", "pg_num": 4}]: dispatch 2024-06-11T17:19:30.156 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:27.039782+0000 mon.c [INF] from='client.4520 172.21.15.130:0/1747873126' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi130-31677-4"}]: dispatch 2024-06-11T17:19:30.156 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: got: 2024-06-11T17:19:27.040921+0000 mon.a [INF] from='client.4520 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi130-31677-4"}]: dispatch 2024-06-11T17:19:30.156 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (8128 ms) 2024-06-11T17:19:30.156 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (11394 ms total) 2024-06-11T17:19:30.156 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: 2024-06-11T17:19:30.156 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: [----------] Global test environment tear-down 2024-06-11T17:19:30.156 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (11394 ms total) 2024-06-11T17:19:30.156 INFO:tasks.workunit.client.0.smithi130.stdout: api_cmd: [ PASSED ] 4 tests. 2024-06-11T17:19:31.115 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: Running main() from gmock_main.cc 2024-06-11T17:19:31.115 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2024-06-11T17:19:31.115 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2024-06-11T17:19:31.115 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2024-06-11T17:19:31.115 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2024-06-11T17:19:31.115 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: notify 2024-06-11T17:19:31.115 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotify (1184 ms) 2024-06-11T17:19:31.115 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-06-11T17:19:31.116 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (10 ms) 2024-06-11T17:19:31.116 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (1194 ms total) 2024-06-11T17:19:31.116 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: 2024-06-11T17:19:31.116 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2024-06-11T17:19:31.116 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2024-06-11T17:19:31.116 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: notify 2024-06-11T17:19:31.116 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (147 ms) 2024-06-11T17:19:31.116 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2024-06-11T17:19:31.116 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: notify 2024-06-11T17:19:31.116 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (4038 ms) 2024-06-11T17:19:31.116 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2024-06-11T17:19:31.116 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (8 ms) 2024-06-11T17:19:31.116 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2024-06-11T17:19:31.117 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (5 ms) 2024-06-11T17:19:31.117 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2024-06-11T17:19:31.117 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: handle_notify cookie 94916600563792 notify_id 128849018881 notifier_gid 5002 2024-06-11T17:19:31.117 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (6 ms) 2024-06-11T17:19:31.117 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2024-06-11T17:19:31.117 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: handle_notify cookie 94916600563792 notify_id 128849018882 notifier_gid 5002 2024-06-11T17:19:31.117 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (7 ms) 2024-06-11T17:19:31.117 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2024-06-11T17:19:31.117 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: handle_notify cookie 94916600563792 notify_id 128849018883 notifier_gid 5002 2024-06-11T17:19:31.117 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (10 ms) 2024-06-11T17:19:31.117 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2024-06-11T17:19:31.117 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: handle_notify cookie 94916600563792 notify_id 128849018888 notifier_gid 5002 2024-06-11T17:19:31.117 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (5 ms) 2024-06-11T17:19:31.117 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2024-06-11T17:19:31.118 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: handle_notify cookie 94916600563792 notify_id 128849018884 notifier_gid 5002 2024-06-11T17:19:31.118 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: handle_notify cookie 94916600563792 notify_id 128849018885 notifier_gid 5002 2024-06-11T17:19:31.118 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (7 ms) 2024-06-11T17:19:31.118 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2024-06-11T17:19:31.118 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: handle_notify cookie 94916600576768 notify_id 128849018889 notifier_gid 5002 2024-06-11T17:19:31.118 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (6 ms) 2024-06-11T17:19:31.118 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2024-06-11T17:19:31.118 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: trying... 2024-06-11T17:19:31.871 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: handle_notify cookie 94916600576768 notify_id 128849018886 notifier ec_io: Running main() from gmock_main.cc 2024-06-11T17:19:31.871 INFO:tasks.workunit.client.0.smithi130.stdout: ec_io: [==========] Running 2 tests from 1 test suite. 2024-06-11T17:19:31.871 INFO:tasks.workunit.client.0.smithi130.stdout: ec_io: [----------] Global test environment set-up. 2024-06-11T17:19:31.871 INFO:tasks.workunit.client.0.smithi130.stdout: ec_io: [----------] 2 tests from NeoRadosECIo 2024-06-11T17:19:31.871 INFO:tasks.workunit.client.0.smithi130.stdout: ec_io: [ RUN ] NeoRadosECIo.SimpleWrite 2024-06-11T17:19:31.871 INFO:tasks.workunit.client.0.smithi130.stdout: ec_io: [ OK ] NeoRadosECIo.SimpleWrite (6147 ms) 2024-06-11T17:19:31.871 INFO:tasks.workunit.client.0.smithi130.stdout: ec_io: [ RUN ] NeoRadosECIo.ReadOp 2024-06-11T17:19:31.871 INFO:tasks.workunit.client.0.smithi130.stdout: ec_io: [ OK ] NeoRadosECIo.ReadOp (6794 ms) 2024-06-11T17:19:31.871 INFO:tasks.workunit.client.0.smithi130.stdout: ec_io: [----------] 2 tests from NeoRadosECIo (12941 ms total) 2024-06-11T17:19:31.871 INFO:tasks.workunit.client.0.smithi130.stdout: ec_io: 2024-06-11T17:19:31.871 INFO:tasks.workunit.client.0.smithi130.stdout: ec_io: [----------] Global test environment tear-down 2024-06-11T17:19:31.872 INFO:tasks.workunit.client.0.smithi130.stdout: ec_io: [==========] 2 tests from 1 test suite ran. (12941 ms total) 2024-06-11T17:19:31.872 INFO:tasks.workunit.client.0.smithi130.stdout: ec_io: [ PASSED ] 2 tests. 2024-06-11T17:19:31.894 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: Running main() from gmock_main.cc 2024-06-11T17:19:31.894 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2024-06-11T17:19:31.894 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [----------] Global test environment set-up. 2024-06-11T17:19:31.894 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [----------] 8 tests from LibRadosLock 2024-06-11T17:19:31.894 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2024-06-11T17:19:31.894 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (205 ms) 2024-06-11T17:19:31.894 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2024-06-11T17:19:31.894 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [ OK ] LibRadosLock.LockShared (31 ms) 2024-06-11T17:19:31.895 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2024-06-11T17:19:31.895 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (1095 ms) 2024-06-11T17:19:31.895 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2024-06-11T17:19:31.895 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (1009 ms) 2024-06-11T17:19:31.895 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2024-06-11T17:19:31.895 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (5 ms) 2024-06-11T17:19:31.895 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2024-06-11T17:19:31.895 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [ OK ] LibRadosLock.Unlock (8 ms) 2024-06-11T17:19:31.895 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2024-06-11T17:19:31.895 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (9 ms) 2024-06-11T17:19:31.895 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2024-06-11T17:19:31.895 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (5 ms) 2024-06-11T17:19:31.895 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [----------] 8 tests from LibRadosLock (2368 ms total) 2024-06-11T17:19:31.895 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: 2024-06-11T17:19:31.896 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2024-06-11T17:19:31.896 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2024-06-11T17:19:31.896 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusive (942 ms) 2024-06-11T17:19:31.896 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2024-06-11T17:19:31.896 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [ OK ] LibRadosLockEC.LockShared (6 ms) 2024-06-11T17:19:31.896 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2024-06-11T17:19:31.896 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusiveDur (1048 ms) 2024-06-11T17:19:31.896 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2024-06-11T17:19:31.896 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [ OK ] LibRadosLockEC.LockSharedDur (1064 ms) 2024-06-11T17:19:31.896 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2024-06-11T17:19:31.896 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [ OK ] LibRadosLockEC.LockMayRenew (10 ms) 2024-06-11T17:19:31.896 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2024-06-11T17:19:31.896 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [ OK ] LibRadosLockEC.Unlock (19 ms) 2024-06-11T17:19:31.896 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2024-06-11T17:19:31.897 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [ OK ] LibRadosLockEC.ListLockers (16 ms) 2024-06-11T17:19:31.897 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2024-06-11T17:19:31.897 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [ OK ] LibRadosLockEC.BreakLock (8 ms) 2024-06-11T17:19:31.897 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (3113 ms total) 2024-06-11T17:19:31.897 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: 2024-06-11T17:19:31.897 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [----------] Global test environment tear-down 2024-06-11T17:19:31.897 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (13281 ms total) 2024-06-11T17:19:31.897 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock: [ PASSED ] 16 tests. 2024-06-11T17:19:31.920 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: Running main() from gmock_main.cc 2024-06-11T17:19:31.920 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2024-06-11T17:19:31.920 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [----------] Global test environment set-up. 2024-06-11T17:19:31.920 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2024-06-11T17:19:31.920 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: seed 31562 2024-06-11T17:19:31.920 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2024-06-11T17:19:31.920 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (262 ms) 2024-06-11T17:19:31.921 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2024-06-11T17:19:31.921 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (5 ms) 2024-06-11T17:19:31.921 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2024-06-11T17:19:31.921 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (1069 ms) 2024-06-11T17:19:31.921 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2024-06-11T17:19:31.921 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (1010 ms) 2024-06-11T17:19:31.921 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2024-06-11T17:19:31.921 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (7 ms) 2024-06-11T17:19:31.921 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2024-06-11T17:19:31.921 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (9 ms) 2024-06-11T17:19:31.921 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2024-06-11T17:19:31.921 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (8 ms) 2024-06-11T17:19:31.921 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2024-06-11T17:19:31.921 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (6 ms) 2024-06-11T17:19:31.922 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (2376 ms total) 2024-06-11T17:19:31.922 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: 2024-06-11T17:19:31.922 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2024-06-11T17:19:31.922 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2024-06-11T17:19:31.922 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusivePP (964 ms) 2024-06-11T17:19:31.922 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2024-06-11T17:19:31.922 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedPP (5 ms) 2024-06-11T17:19:31.922 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2024-06-11T17:19:31.922 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusiveDurPP (1060 ms) 2024-06-11T17:19:31.922 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2024-06-11T17:19:31.922 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedDurPP (1041 ms) 2024-06-11T17:19:31.922 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2024-06-11T17:19:31.922 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockMayRenewPP (16 ms) 2024-06-11T17:19:31.923 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2024-06-11T17:19:31.923 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.UnlockPP (17 ms) 2024-06-11T17:19:31.923 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2024-06-11T17:19:31.923 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.ListLockersPP (9 ms) 2024-06-11T17:19:31.923 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2024-06-11T17:19:31.923 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.BreakLockPP (7 ms) 2024-06-11T17:19:31.923 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (3119 ms total) 2024-06-11T17:19:31.923 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: 2024-06-11T17:19:31.923 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [----------] Global test environment tear-down 2024-06-11T17:19:31.923 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (13277 ms total) 2024-06-11T17:19:31.923 INFO:tasks.workunit.client.0.smithi130.stdout: api_lock_pp: [ PASSED ] 16 tests. 2024-06-11T17:19:32.911 INFO:tasks.workunit.client.0.smithi130.stdout: pool: Running main() from gmock_main.cc 2024-06-11T17:19:32.912 INFO:tasks.workunit.client.0.smithi130.stdout: pool: [==========] Running 6 tests from 1 test suite. 2024-06-11T17:19:32.912 INFO:tasks.workunit.client.0.smithi130.stdout: pool: [----------] Global test environment set-up. 2024-06-11T17:19:32.912 INFO:tasks.workunit.client.0.smithi130.stdout: pool: [----------] 6 tests from NeoRadosPools 2024-06-11T17:19:32.912 INFO:tasks.workunit.client.0.smithi130.stdout: pool: [ RUN ] NeoRadosPools.PoolList 2024-06-11T17:19:32.912 INFO:tasks.workunit.client.0.smithi130.stdout: pool: [ OK ] NeoRadosPools.PoolList (2080 ms) 2024-06-11T17:19:32.912 INFO:tasks.workunit.client.0.smithi130.stdout: pool: [ RUN ] NeoRadosPools.PoolLookup 2024-06-11T17:19:32.912 INFO:tasks.workunit.client.0.smithi130.stdout: pool: [ OK ] NeoRadosPools.PoolLookup (2067 ms) 2024-06-11T17:19:32.912 INFO:tasks.workunit.client.0.smithi130.stdout: pool: [ RUN ] NeoRadosPools.PoolLookupOtherInstance 2024-06-11T17:19:32.912 INFO:tasks.workunit.client.0.smithi130.stdout: pool: [ OK ] NeoRadosPools.PoolLookupOtherInstance (2004 ms) 2024-06-11T17:19:32.913 INFO:tasks.workunit.client.0.smithi130.stdout: pool: [ RUN ] NeoRadosPools.PoolDelete 2024-06-11T17:19:32.913 INFO:tasks.workunit.client.0.smithi130.stdout: pool: [ OK ] NeoRadosPools.PoolDelete (3804 ms) 2024-06-11T17:19:32.913 INFO:tasks.workunit.client.0.smithi130.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateDelete 2024-06-11T17:19:32.913 INFO:tasks.workunit.client.0.smithi130.stdout: pool: [ OK ] NeoRadosPools.PoolCreateDelete (2043 ms) 2024-06-11T17:19:32.913 INFO:tasks.workunit.client.0.smithi130.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2024-06-11T17:19:32.913 INFO:tasks.workunit.client.0.smithi130.stdout: pool: [ OK ] NeoRadosPools.PoolCreateWithCrushRule (1955 ms) 2024-06-11T17:19:32.913 INFO:tasks.workunit.client.0.smithi130.stdout: pool: [----------] 6 tests from NeoRadosPools (13953 ms total) 2024-06-11T17:19:32.913 INFO:tasks.workunit.client.0.smithi130.stdout: pool: 2024-06-11T17:19:32.913 INFO:tasks.workunit.client.0.smithi130.stdout: pool: [----------] Global test environment tear-down 2024-06-11T17:19:32.913 INFO:tasks.workunit.client.0.smithi130.stdout: pool: [==========] 6 tests from 1 test suite ran. (13953 ms total) 2024-06-11T17:19:32.913 INFO:tasks.workunit.client.0.smithi130.stdout: pool: [ PASSED ] 6 tests. 2024-06-11T17:19:37.935 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: Running main() from gmock_main.cc 2024-06-11T17:19:37.935 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2024-06-11T17:19:37.935 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: [----------] Global test environment set-up. 2024-06-11T17:19:37.935 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2024-06-11T17:19:37.935 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2024-06-11T17:19:37.935 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: watch_notify_test_cb 2024-06-11T17:19:37.935 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (263 ms) 2024-06-11T17:19:37.935 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2024-06-11T17:19:37.935 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2024-06-11T17:19:37.936 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94390053361168 err -107 2024-06-11T17:19:37.936 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (1032 ms) 2024-06-11T17:19:37.936 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2024-06-11T17:19:37.936 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94390053361168 err -107 2024-06-11T17:19:37.936 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2024-06-11T17:19:37.936 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (16 ms) 2024-06-11T17:19:37.936 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2024-06-11T17:19:37.936 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: watch_notify2_test_cb from 4430 notify_id 85899345920 cookie 94390053372992 2024-06-11T17:19:37.936 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (11 ms) 2024-06-11T17:19:37.936 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2024-06-11T17:19:37.936 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: watch_notify2_test_cb from 4430 notify_id 85899345920 cookie 94390053405296 2024-06-11T17:19:37.936 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (16 ms) 2024-06-11T17:19:37.936 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2024-06-11T17:19:37.936 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: watch_notify2_test_cb from 4430 notify_id 85899345920 cookie 94390053408880 2024-06-11T17:19:37.936 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (11 ms) 2024-06-11T17:19:37.937 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2024-06-11T17:19:37.937 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: watch_notify2_test_cb from 4430 notify_id 85899345922 cookie 94390053408880 2024-06-11T17:19:37.937 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: watch_notify2_test_cb from 4430 notify_id 85899345922 cookie 94390053424320 2024-06-11T17:19:37.937 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (8 ms) 2024-06-11T17:19:37.937 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2024-06-11T17:19:37.937 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: watch_notify2_test_cb from 4430 notify_id 85899345923 cookie 94390053408880 2024-06-11T17:19:37.937 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: watch_notify2_test_cb from 4430 notify_id 90194313220 cookie 94390053408880 2024-06-11T17:19:37.937 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3010 ms) 2024-06-11T17:19:37.937 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2024-06-11T17:19:37.937 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: waiting up to 1024 for osd to time us out ... 2024-06-11T17:19:37.937 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94390053408880 err -107 2024-06-11T17:19:37.937 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: watch_notify2_test_cb from 4430 notify_id 120259084294 cookie 94390053408880 2024-06-11T17:19:37.937 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (5017 ms) 2024-06-11T17:19:37.937 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2024-06-11T17:19:37.937 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2024-06-11T17:19:37.938 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94390053408880 err -107 2024-06-11T17:19:37.938 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (1014 ms) 2024-06-11T17:19:37.938 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (10398 ms total) 2024-06-11T17:19:37.938 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: 2024-06-11T17:19:37.938 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2024-06-11T17:19:37.938 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2024-06-11T17:19:37.938 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: watch_notify_test_cb 2024-06-11T17:19:37.938 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: [ OK ] LibRadosWatchNotifyEC.WatchNotify (1055 ms) 2024-06-11T17:19:37.938 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (1055 ms total) 2024-06-11T17:19:37.938 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: 2024-06-11T17:19:37.938 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: [----------] Global test environment tear-down 2024-06-11T17:19:37.938 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (19211 ms total) 2024-06-11T17:19:37.955 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify: [ PASSED ] 11 tests. 2024-06-11T17:19:44.969 INFO:tasks.workunit.client.0.smithi130.stdout: ec_list: Running main() from gmock_main.cc 2024-06-11T17:19:44.969 INFO:tasks.workunit.client.0.smithi130.stdout: ec_list: [==========] Running 3 tests from 1 test suite. 2024-06-11T17:19:44.969 INFO:tasks.workunit.client.0.smithi130.stdout: ec_list: [----------] Global test environment set-up. 2024-06-11T17:19:44.969 INFO:tasks.workunit.client.0.smithi130.stdout: ec_list: [----------] 3 tests from NeoradosECList 2024-06-11T17:19:44.970 INFO:tasks.workunit.client.0.smithi130.stdout: ec_list: [ RUN ] NeoradosECList.ListObjects 2024-06-11T17:19:44.970 INFO:tasks.workunit.client.0.smithi130.stdout: ec_list: [ OK ] NeoradosECList.ListObjects (7122 ms) 2024-06-11T17:19:44.970 INFO:tasks.workunit.client.0.smithi130.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsNS 2024-06-11T17:19:44.970 INFO:tasks.workunit.client.0.smithi130.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsNS (6837 ms) 2024-06-11T17:19:44.970 INFO:tasks.workunit.client.0.smithi130.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsMany 2024-06-11T17:19:44.970 INFO:tasks.workunit.client.0.smithi130.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsMany (12055 ms) 2024-06-11T17:19:44.970 INFO:tasks.workunit.client.0.smithi130.stdout: ec_list: [----------] 3 tests from NeoradosECList (26014 ms total) 2024-06-11T17:19:44.970 INFO:tasks.workunit.client.0.smithi130.stdout: ec_list: 2024-06-11T17:19:44.970 INFO:tasks.workunit.client.0.smithi130.stdout: ec_list: [----------] Global test environment tear-down 2024-06-11T17:19:44.970 INFO:tasks.workunit.client.0.smithi130.stdout: ec_list: [==========] 3 tests from 1 test suite ran. (26014 ms total) 2024-06-11T17:19:44.970 INFO:tasks.workunit.client.0.smithi130.stdout: ec_list: [ PASSED ] 3 tests. 2024-06-11T17:19:44.989 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_write_operations: Running main() from gmock_main.cc 2024-06-11T17:19:44.989 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_write_operations: [==========] Running 8 tests from 2 test suites. 2024-06-11T17:19:44.989 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_write_operations: [----------] Global test environment set-up. 2024-06-11T17:19:44.989 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps 2024-06-11T17:19:44.989 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_write_operations: [ RUN ] LibradosCWriteOps.NewDelete 2024-06-11T17:19:44.989 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_write_operations: [ OK ] LibradosCWriteOps.NewDelete (0 ms) 2024-06-11T17:19:44.990 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps (0 ms total) 2024-06-11T17:19:44.990 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_write_operations: 2024-06-11T17:19:44.990 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps 2024-06-11T17:19:44.990 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.assertExists 2024-06-11T17:19:44.990 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.assertExists (2266 ms) 2024-06-11T17:19:44.990 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2024-06-11T17:19:44.990 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteOpAssertVersion (3011 ms) 2024-06-11T17:19:44.990 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Xattrs 2024-06-11T17:19:44.990 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Xattrs (2819 ms) 2024-06-11T17:19:44.991 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Write 2024-06-11T17:19:44.991 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Write (3021 ms) 2024-06-11T17:19:44.991 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Exec 2024-06-11T17:19:44.991 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Exec (3004 ms) 2024-06-11T17:19:44.991 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteSame 2024-06-11T17:19:44.991 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteSame (3025 ms) 2024-06-11T17:19:44.991 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.CmpExt 2024-06-11T17:19:44.991 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.CmpExt (9053 ms) 2024-06-11T17:19:44.991 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps (26199 ms total) 2024-06-11T17:19:44.991 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_write_operations: 2024-06-11T17:19:44.992 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_write_operations: [----------] Global test environment tear-down 2024-06-11T17:19:44.992 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_write_operations: [==========] 8 tests from 2 test suites ran. (26199 ms total) 2024-06-11T17:19:44.992 INFO:tasks.workunit.client.0.smithi130.stdout: api_c_write_operations: [ PASSED ] 8 tests. 2024-06-11T17:19:44.995 INFO:tasks.workunit.client.0.smithi130.stdout: write_operations: Running main() from gmock_main.cc 2024-06-11T17:19:44.995 INFO:tasks.workunit.client.0.smithi130.stdout: write_operations: [==========] Running 7 tests from 1 test suite. 2024-06-11T17:19:44.995 INFO:tasks.workunit.client.0.smithi130.stdout: write_operations: [----------] Global test environment set-up. 2024-06-11T17:19:44.995 INFO:tasks.workunit.client.0.smithi130.stdout: write_operations: [----------] 7 tests from NeoRadosWriteOps 2024-06-11T17:19:44.995 INFO:tasks.workunit.client.0.smithi130.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertExists 2024-06-11T17:19:44.995 INFO:tasks.workunit.client.0.smithi130.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertExists (3047 ms) 2024-06-11T17:19:44.995 INFO:tasks.workunit.client.0.smithi130.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertVersion 2024-06-11T17:19:44.995 INFO:tasks.workunit.client.0.smithi130.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertVersion (3020 ms) 2024-06-11T17:19:44.995 INFO:tasks.workunit.client.0.smithi130.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Xattrs 2024-06-11T17:19:44.996 INFO:tasks.workunit.client.0.smithi130.stdout: write_operations: [ OK ] NeoRadosWriteOps.Xattrs (2817 ms) 2024-06-11T17:19:44.996 INFO:tasks.workunit.client.0.smithi130.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Write 2024-06-11T17:19:44.996 INFO:tasks.workunit.client.0.smithi130.stdout: write_operations: [ OK ] NeoRadosWriteOps.Write (3050 ms) 2024-06-11T17:19:44.996 INFO:tasks.workunit.client.0.smithi130.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Exec 2024-06-11T17:19:44.996 INFO:tasks.workunit.client.0.smithi130.stdout: write_operations: [ OK ] NeoRadosWriteOps.Exec (2945 ms) 2024-06-11T17:19:44.996 INFO:tasks.workunit.client.0.smithi130.stdout: write_operations: [ RUN ] NeoRadosWriteOps.WriteSame 2024-06-11T17:19:44.996 INFO:tasks.workunit.client.0.smithi130.stdout: write_operations: [ OK ] NeoRadosWriteOps.WriteSame (3025 ms) 2024-06-11T17:19:44.996 INFO:tasks.workunit.client.0.smithi130.stdout: write_operations: [ RUN ] NeoRadosWriteOps.CmpExt 2024-06-11T17:19:44.996 INFO:tasks.workunit.client.0.smithi130.stdout: write_operations: [ OK ] NeoRadosWriteOps.CmpExt (8072 ms) 2024-06-11T17:19:44.996 INFO:tasks.workunit.client.0.smithi130.stdout: write_operations: [----------] 7 tests from NeoRadosWriteOps (25976 ms total) 2024-06-11T17:19:44.996 INFO:tasks.workunit.client.0.smithi130.stdout: write_operations: 2024-06-11T17:19:44.996 INFO:tasks.workunit.client.0.smithi130.stdout: write_operations: [----------] Global test environment tear-down 2024-06-11T17:19:44.996 INFO:tasks.workunit.client.0.smithi130.stdout: write_operations: [==========] 7 tests from 1 test suite ran. (25976 ms total) 2024-06-11T17:19:44.996 INFO:tasks.workunit.client.0.smithi130.stdout: write_operations: [ PASSED ] 7 tests. 2024-06-11T17:19:46.449 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: [==========] Running 4 tests from 1 test suite. 2024-06-11T17:19:46.449 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: [----------] Global test environment set-up. 2024-06-11T17:19:46.449 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: [----------] 4 tests from LibRadosService 2024-06-11T17:19:46.449 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2024-06-11T17:19:46.449 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5101 ms) 2024-06-11T17:19:46.450 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2024-06-11T17:19:46.450 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: [ OK ] LibRadosService.RegisterLate (44 ms) 2024-06-11T17:19:46.450 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2024-06-11T17:19:46.450 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: cluster: 2024-06-11T17:19:46.450 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: id: fae1d0b0-28f2-4ebc-8a2f-59aed9de5555 2024-06-11T17:19:46.450 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: health: HEALTH_WARN 2024-06-11T17:19:46.450 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: 15 pool(s) do not have an application enabled 2024-06-11T17:19:46.450 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: 2024-06-11T17:19:46.450 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: services: 2024-06-11T17:19:46.450 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 76s) 2024-06-11T17:19:46.450 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: mgr: y(active, since 71s), standbys: x 2024-06-11T17:19:46.450 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: osd: 8 osds: 8 up (since 65s), 8 in (since 74s) 2024-06-11T17:19:46.450 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: laundry: 2 daemons active (1 hosts) 2024-06-11T17:19:46.450 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: 2024-06-11T17:19:46.451 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: data: 2024-06-11T17:19:46.451 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: pools: 26 pools, 705 pgs 2024-06-11T17:19:46.451 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: objects: 2 objects, 577 KiB 2024-06-11T17:19:46.451 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: usage: 213 MiB used, 720 GiB / 720 GiB avail 2024-06-11T17:19:46.451 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: pgs: 74.043% pgs unknown 2024-06-11T17:19:46.451 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: 24.681% pgs not active 2024-06-11T17:19:46.451 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: 522 unknown 2024-06-11T17:19:46.451 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: 174 creating+peering 2024-06-11T17:19:46.451 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: 9 active+clean 2024-06-11T17:19:46.451 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: 2024-06-11T17:19:46.451 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: 2024-06-11T17:19:46.451 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: cluster: 2024-06-11T17:19:46.451 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: id: fae1d0b0-28f2-4ebc-8a2f-59aed9de5555 2024-06-11T17:19:46.451 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: health: HEALTH_WARN 2024-06-11T17:19:46.451 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: 15 pool(s) do not have an application enabled 2024-06-11T17:19:46.451 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: 2024-06-11T17:19:46.452 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: services: 2024-06-11T17:19:46.452 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 78s) 2024-06-11T17:19:46.452 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: mgr: y(active, since 73s), standbys: x 2024-06-11T17:19:46.452 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: osd: 8 osds: 8 up (since 67s), 8 in (since 76s) 2024-06-11T17:19:46.452 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2024-06-11T17:19:46.452 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: laundry: 1 daemon active (1 hosts) 2024-06-11T17:19:46.452 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: 2024-06-11T17:19:46.452 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: data: 2024-06-11T17:19:46.452 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: pools: 26 pools, 705 pgs 2024-06-11T17:19:46.452 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: objects: 54 objects, 581 KiB 2024-06-11T17:19:46.452 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: usage: 245 MiB used, 720 GiB / 720 GiB avail 2024-06-11T17:19:46.452 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: pgs: 6.383% pgs unknown 2024-06-11T17:19:46.452 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: 27.234% pgs not active 2024-06-11T17:19:46.452 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: 467 active+clean 2024-06-11T17:19:46.452 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: 180 creating+peering 2024-06-11T17:19:46.453 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: 45 unknown 2024-06-11T17:19:46.453 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: 12 creating+activating 2024-06-11T17:19:46.453 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: 1 active 2024-06-11T17:19:46.453 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: 2024-06-11T17:19:46.453 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: io: 2024-06-11T17:19:46.453 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: client: 1.7 KiB/s rd, 23 KiB/s wr, 183 op/s rd, 218 op/s wr 2024-06-11T17:19:46.453 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: 2024-06-11T17:19:46.453 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: 2024-06-11T17:19:46.453 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: [ OK ] LibRadosService.StatusFormat (2454 ms) 2024-06-11T17:19:46.453 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: [ RUN ] LibRadosService.Status 2024-06-11T17:19:46.453 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: [ OK ] LibRadosService.Status (20052 ms) 2024-06-11T17:19:46.453 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: [----------] 4 tests from LibRadosService (27652 ms total) 2024-06-11T17:19:46.453 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: 2024-06-11T17:19:46.453 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: [----------] Global test environment tear-down 2024-06-11T17:19:46.453 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: [==========] 4 tests from 1 test suite ran. (27652 ms total) 2024-06-11T17:19:46.454 INFO:tasks.workunit.client.0.smithi130.stdout: api_service: [ PASSED ] 4 tests. 2024-06-11T17:19:46.942 INFO:tasks.workunit.client.0.smithi130.stdout:_gid 5002 2024-06-11T17:19:46.942 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: timed out 2024-06-11T17:19:46.942 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: flushing 2024-06-11T17:19:46.942 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: flushed 2024-06-11T17:19:46.942 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3005 ms) 2024-06-11T17:19:46.942 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2024-06-11T17:19:46.942 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: trying... 2024-06-11T17:19:46.942 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: handle_notify cookie 94916600576768 notify_id 141733920775 notifier_gid 5002 2024-06-11T17:19:46.942 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: timed out 2024-06-11T17:19:46.943 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: flushing 2024-06-11T17:19:46.943 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: flushed 2024-06-11T17:19:46.943 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3011 ms) 2024-06-11T17:19:46.943 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2024-06-11T17:19:46.943 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: List watches 2024-06-11T17:19:46.943 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: notify2 2024-06-11T17:19:46.943 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: handle_notify cookie 94916600576768 notify_id 154618822664 notifier_gid 5002 2024-06-11T17:19:46.943 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: notify2 done 2024-06-11T17:19:46.943 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: watch_check 2024-06-11T17:19:46.943 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: unwatch2 2024-06-11T17:19:46.943 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: flushing 2024-06-11T17:19:46.943 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: done 2024-06-11T17:19:46.943 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3027 ms) 2024-06-11T17:19:46.943 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2024-06-11T17:19:46.944 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: List watches 2024-06-11T17:19:46.944 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: notify2 2024-06-11T17:19:46.944 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: handle_notify cookie 94916600566288 notify_id 167503724553 notifier_gid 5002 2024-06-11T17:19:46.944 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: notify2 done 2024-06-11T17:19:46.944 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: watch_check 2024-06-11T17:19:46.944 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: unwatch2 2024-06-11T17:19:46.944 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: flushing 2024-06-11T17:19:46.944 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: done 2024-06-11T17:19:46.944 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3040 ms) 2024-06-11T17:19:46.944 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (16322 ms total) 2024-06-11T17:19:46.944 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: 2024-06-11T17:19:46.944 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2024-06-11T17:19:46.944 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (28190 ms total) 2024-06-11T17:19:46.945 INFO:tasks.workunit.client.0.smithi130.stdout: api_watch_notify_pp: [ PASSED ] 16 tests. 2024-06-11T17:19:51.984 INFO:tasks.workunit.client.0.smithi130.stdout: misc: Running main() from gmock_main.cc 2024-06-11T17:19:51.984 INFO:tasks.workunit.client.0.smithi130.stdout: misc: [==========] Running 12 tests from 1 test suite. 2024-06-11T17:19:51.984 INFO:tasks.workunit.client.0.smithi130.stdout: misc: [----------] Global test environment set-up. 2024-06-11T17:19:51.984 INFO:tasks.workunit.client.0.smithi130.stdout: misc: [----------] 12 tests from NeoRadosMisc 2024-06-11T17:19:51.985 INFO:tasks.workunit.client.0.smithi130.stdout: misc: [ RUN ] NeoRadosMisc.Version 2024-06-11T17:19:51.985 INFO:tasks.workunit.client.0.smithi130.stdout: misc: [ OK ] NeoRadosMisc.Version (2103 ms) 2024-06-11T17:19:51.985 INFO:tasks.workunit.client.0.smithi130.stdout: misc: [ RUN ] NeoRadosMisc.WaitOSDMap 2024-06-11T17:19:51.985 INFO:tasks.workunit.client.0.smithi130.stdout: misc: [ OK ] NeoRadosMisc.WaitOSDMap (2040 ms) 2024-06-11T17:19:51.985 INFO:tasks.workunit.client.0.smithi130.stdout: misc: [ RUN ] NeoRadosMisc.LongName 2024-06-11T17:19:51.985 INFO:tasks.workunit.client.0.smithi130.stdout: misc: [ OK ] NeoRadosMisc.LongName (2992 ms) 2024-06-11T17:19:51.985 INFO:tasks.workunit.client.0.smithi130.stdout: misc: [ RUN ] NeoRadosMisc.LongLocator 2024-06-11T17:19:51.985 INFO:tasks.workunit.client.0.smithi130.stdout: misc: [ OK ] NeoRadosMisc.LongLocator (2809 ms) 2024-06-11T17:19:51.985 INFO:tasks.workunit.client.0.smithi130.stdout: misc: [ RUN ] NeoRadosMisc.LongNamespace 2024-06-11T17:19:51.985 INFO:tasks.workunit.client.0.smithi130.stdout: misc: [ OK ] NeoRadosMisc.LongNamespace (2998 ms) 2024-06-11T17:19:51.985 INFO:tasks.workunit.client.0.smithi130.stdout: misc: [ RUN ] NeoRadosMisc.LongAttrName 2024-06-11T17:19:51.985 INFO:tasks.workunit.client.0.smithi130.stdout: misc: [ OK ] NeoRadosMisc.LongAttrName (3012 ms) 2024-06-11T17:19:51.985 INFO:tasks.workunit.client.0.smithi130.stdout: misc: [ RUN ] NeoRadosMisc.Exec 2024-06-11T17:19:51.986 INFO:tasks.workunit.client.0.smithi130.stdout: misc: [ OK ] NeoRadosMisc.Exec (3031 ms) 2024-06-11T17:19:51.986 INFO:tasks.workunit.client.0.smithi130.stdout: misc: [ RUN ] NeoRadosMisc.Operate1 2024-06-11T17:19:51.986 INFO:tasks.workunit.client.0.smithi130.stdout: misc: [ OK ] NeoRadosMisc.Operate1 (3030 ms) 2024-06-11T17:19:51.986 INFO:tasks.workunit.client.0.smithi130.stdout: misc: [ RUN ] NeoRadosMisc.Operate2 2024-06-11T17:19:51.986 INFO:tasks.workunit.client.0.smithi130.stdout: misc: [ OK ] NeoRadosMisc.Operate2 (2962 ms) 2024-06-11T17:19:51.986 INFO:tasks.workunit.client.0.smithi130.stdout: misc: [ RUN ] NeoRadosMisc.BigObject 2024-06-11T17:19:51.986 INFO:tasks.workunit.client.0.smithi130.stdout: misc: [ OK ] NeoRadosMisc.BigObject (3004 ms) 2024-06-11T17:19:51.986 INFO:tasks.workunit.client.0.smithi130.stdout: misc: [ RUN ] NeoRadosMisc.BigAttr 2024-06-11T17:19:51.986 INFO:tasks.workunit.client.0.smithi130.stdout: misc: [ OK ] NeoRadosMisc.BigAttr (2105 ms) 2024-06-11T17:19:51.986 INFO:tasks.workunit.client.0.smithi130.stdout: misc: [ RUN ] NeoRadosMisc.WriteSame 2024-06-11T17:19:51.986 INFO:tasks.workunit.client.0.smithi130.stdout: misc: [ OK ] NeoRadosMisc.WriteSame (2948 ms) 2024-06-11T17:19:51.986 INFO:tasks.workunit.client.0.smithi130.stdout: misc: [----------] 12 tests from NeoRadosMisc (33034 ms total) 2024-06-11T17:19:51.986 INFO:tasks.workunit.client.0.smithi130.stdout: misc: 2024-06-11T17:19:51.986 INFO:tasks.workunit.client.0.smithi130.stdout: misc: [----------] Global test environment tear-down 2024-06-11T17:19:51.987 INFO:tasks.workunit.client.0.smithi130.stdout: misc: [==========] 12 tests from 1 test suite ran. (33034 ms total) 2024-06-11T17:19:51.987 INFO:tasks.workunit.client.0.smithi130.stdout: misc: [ PASSED ] 12 tests. 2024-06-11T17:19:54.382 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: [==========] Running 4 tests from 1 test suite. 2024-06-11T17:19:54.382 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: [----------] Global test environment set-up. 2024-06-11T17:19:54.383 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2024-06-11T17:19:54.383 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2024-06-11T17:19:54.383 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5043 ms) 2024-06-11T17:19:54.383 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2024-06-11T17:19:54.383 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (59 ms) 2024-06-11T17:19:54.383 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2024-06-11T17:19:54.384 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (20048 ms) 2024-06-11T17:19:54.384 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2024-06-11T17:19:54.384 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: attempt 0 of 20 2024-06-11T17:19:54.384 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: failed to deregister: 2024-06-11T17:19:54.384 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: { 2024-06-11T17:19:54.384 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: "epoch": 8, 2024-06-11T17:19:54.385 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: "modified": "2024-06-11T17:19:46.846503+0000", 2024-06-11T17:19:54.385 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: "services": { 2024-06-11T17:19:54.385 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: "laundry": { 2024-06-11T17:19:54.385 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: "daemons": { 2024-06-11T17:19:54.385 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: "summary": "", 2024-06-11T17:19:54.386 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: "close-test-pid31982": { 2024-06-11T17:19:54.386 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: "start_epoch": 7, 2024-06-11T17:19:54.386 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: "start_stamp": "2024-06-11T17:19:44.078621+0000", 2024-06-11T17:19:54.386 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: "gid": 12958, 2024-06-11T17:19:54.386 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: "addr": "172.21.15.130:0/511187372", 2024-06-11T17:19:54.387 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: "metadata": { 2024-06-11T17:19:54.388 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: "arch": "x86_64", 2024-06-11T17:19:54.388 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: "ceph_release": "squid", 2024-06-11T17:19:54.388 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: "ceph_version": "ceph version 19.0.0-4216-g37bbe1d8 (37bbe1d8d788b7c9a71280e7d510c295a5853f0b) squid (dev)", 2024-06-11T17:19:54.388 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: "ceph_version_short": "19.0.0-4216-g37bbe1d8", 2024-06-11T17:19:54.388 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-06-11T17:19:54.388 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: "distro": "ubuntu", 2024-06-11T17:19:54.388 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: "distro_description": "Ubuntu 22.04.1 LTS", 2024-06-11T17:19:54.388 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: "distro_version": "22.04", 2024-06-11T17:19:54.388 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: "foo": "bar", 2024-06-11T17:19:54.388 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: "hostname": "smithi130", 2024-06-11T17:19:54.388 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: "kernel_description": "#122-Ubuntu SMP Thu May 23 07:48:21 UTC 2024", 2024-06-11T17:19:54.389 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: "kernel_version": "5.15.0-112-generic", 2024-06-11T17:19:54.389 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: "mem_swap_kb": "2097148", 2024-06-11T17:19:54.389 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: "mem_total_kb": "32746740", 2024-06-11T17:19:54.389 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: "os": "Linux", 2024-06-11T17:19:54.389 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: "this": "that" 2024-06-11T17:19:54.389 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: }, 2024-06-11T17:19:54.389 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: "task_status": {} 2024-06-11T17:19:54.389 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: } 2024-06-11T17:19:54.389 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: } 2024-06-11T17:19:54.389 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: } 2024-06-11T17:19:54.389 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: } 2024-06-11T17:19:54.389 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: } 2024-06-11T17:19:54.390 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: 2024-06-11T17:19:54.390 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: attempt 1 of 20 2024-06-11T17:19:54.390 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (10418 ms) 2024-06-11T17:19:54.390 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (35568 ms total) 2024-06-11T17:19:54.390 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: 2024-06-11T17:19:54.390 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: [----------] Global test environment tear-down 2024-06-11T17:19:54.390 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (35568 ms total) 2024-06-11T17:19:54.390 INFO:tasks.workunit.client.0.smithi130.stdout: api_service_pp: [ PASSED ] 4 tests. 2024-06-11T17:19:56.020 INFO:tasks.workunit.client.0.smithi130.stdout: api_pool: Running main() from gmock_main.cc 2024-06-11T17:19:56.021 INFO:tasks.workunit.client.0.smithi130.stdout: api_pool: [==========] Running 9 tests from 1 test suite. 2024-06-11T17:19:56.021 INFO:tasks.workunit.client.0.smithi130.stdout: api_pool: [----------] Global test environment set-up. 2024-06-11T17:19:56.021 INFO:tasks.workunit.client.0.smithi130.stdout: api_pool: [----------] 9 tests from LibRadosPools 2024-06-11T17:19:56.021 INFO:tasks.workunit.client.0.smithi130.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2024-06-11T17:19:56.021 INFO:tasks.workunit.client.0.smithi130.stdout: api_pool: [ OK ] LibRadosPools.PoolList (2366 ms) 2024-06-11T17:19:56.021 INFO:tasks.workunit.client.0.smithi130.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2024-06-11T17:19:56.021 INFO:tasks.workunit.client.0.smithi130.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (3036 ms) 2024-06-11T17:19:56.021 INFO:tasks.workunit.client.0.smithi130.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2024-06-11T17:19:56.021 INFO:tasks.workunit.client.0.smithi130.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (2819 ms) 2024-06-11T17:19:56.021 INFO:tasks.workunit.client.0.smithi130.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookupOtherInstance 2024-06-11T17:19:56.021 INFO:tasks.workunit.client.0.smithi130.stdout: api_pool: [ OK ] LibRadosPools.PoolLookupOtherInstance (3027 ms) 2024-06-11T17:19:56.021 INFO:tasks.workunit.client.0.smithi130.stdout: api_pool: [ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2024-06-11T17:19:56.022 INFO:tasks.workunit.client.0.smithi130.stdout: api_pool: [ OK ] LibRadosPools.PoolReverseLookupOtherInstance (3011 ms) 2024-06-11T17:19:56.022 INFO:tasks.workunit.client.0.smithi130.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2024-06-11T17:19:56.022 INFO:tasks.workunit.client.0.smithi130.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (5012 ms) 2024-06-11T17:19:56.022 INFO:tasks.workunit.client.0.smithi130.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2024-06-11T17:19:56.022 INFO:tasks.workunit.client.0.smithi130.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (5012 ms) 2024-06-11T17:19:56.022 INFO:tasks.workunit.client.0.smithi130.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2024-06-11T17:19:56.022 INFO:tasks.workunit.client.0.smithi130.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (5067 ms) 2024-06-11T17:19:56.022 INFO:tasks.workunit.client.0.smithi130.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2024-06-11T17:19:56.022 INFO:tasks.workunit.client.0.smithi130.stdout: api_pool: [ OK ] LibRadosPools.PoolGetBaseTier (8001 ms) 2024-06-11T17:19:56.022 INFO:tasks.workunit.client.0.smithi130.stdout: api_pool: [----------] 9 tests from LibRadosPools (37351 ms total) 2024-06-11T17:19:56.023 INFO:tasks.workunit.client.0.smithi130.stdout: api_pool: 2024-06-11T17:19:56.023 INFO:tasks.workunit.client.0.smithi130.stdout: api_pool: [----------] Global test environment tear-down 2024-06-11T17:19:56.023 INFO:tasks.workunit.client.0.smithi130.stdout: api_pool: [==========] 9 tests from 1 test suite ran. (37351 ms total) 2024-06-11T17:19:56.023 INFO:tasks.workunit.client.0.smithi130.stdout: api_pool: [ PASSED ] 9 tests. 2024-06-11T17:19:59.027 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [==========] Running 12 tests from 4 test suites. 2024-06-11T17:19:59.027 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [----------] Global test environment set-up. 2024-06-11T17:19:59.027 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2024-06-11T17:19:59.027 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2024-06-11T17:19:59.027 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2024-06-11T17:19:59.027 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-06-11T17:19:59.027 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: 2024-06-11T17:19:59.027 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure 2024-06-11T17:19:59.028 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2024-06-11T17:19:59.028 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: unable to get monitor info from DNS SRV with service name: ceph-mon 2024-06-11T17:19:59.028 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: 2024-06-11T17:19:19.277+0000 7efc22762880 -1 failed for service _ceph-mon._tcp 2024-06-11T17:19:59.028 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: 2024-06-11T17:19:19.277+0000 7efc22762880 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2024-06-11T17:19:59.028 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (610 ms) 2024-06-11T17:19:59.028 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2024-06-11T17:19:59.028 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectTimeout (2009 ms) 2024-06-11T17:19:59.028 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure (2619 ms total) 2024-06-11T17:19:59.028 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: 2024-06-11T17:19:59.028 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2024-06-11T17:19:59.028 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2024-06-11T17:19:59.028 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: started 0x559aeee720b0 2024-06-11T17:19:59.028 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: started 0x559aeef0b4d0 2024-06-11T17:19:59.028 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: started 2 aios 2024-06-11T17:19:59.029 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: waiting 0x559aeee720b0 2024-06-11T17:19:59.029 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: waiting 0x559aeef0b4d0 2024-06-11T17:19:59.029 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: done. 2024-06-11T17:19:59.029 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (5602 ms) 2024-06-11T17:19:59.029 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (5602 ms total) 2024-06-11T17:19:59.029 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: 2024-06-11T17:19:59.029 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2024-06-11T17:19:59.029 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2024-06-11T17:19:59.029 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2024-06-11T17:19:59.029 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2024-06-11T17:19:59.029 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [ OK ] LibRadosMisc.Exec (137 ms) 2024-06-11T17:19:59.029 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2024-06-11T17:19:59.029 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (13 ms) 2024-06-11T17:19:59.030 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2024-06-11T17:19:59.030 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (5 ms) 2024-06-11T17:19:59.030 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2024-06-11T17:19:59.030 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [ OK ] LibRadosMisc.Applications (4841 ms) 2024-06-11T17:19:59.030 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2024-06-11T17:19:59.030 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2024-06-11T17:19:59.030 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2024-06-11T17:19:59.030 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2024-06-11T17:19:59.030 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2024-06-11T17:19:59.030 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (24663 ms) 2024-06-11T17:19:59.030 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [----------] 8 tests from LibRadosMisc (29659 ms total) 2024-06-11T17:19:59.030 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: 2024-06-11T17:19:59.030 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [----------] Global test environment tear-down 2024-06-11T17:19:59.031 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [==========] 12 tests from 4 test suites ran. (40296 ms total) 2024-06-11T17:19:59.031 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc: [ PASSED ] 12 tests. 2024-06-11T17:20:00.990 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: Running main() from gmock_main.cc 2024-06-11T17:20:00.990 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [==========] Running 14 tests from 1 test suite. 2024-06-11T17:20:00.990 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [----------] Global test environment set-up. 2024-06-11T17:20:00.990 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [----------] 14 tests from NeoRadosReadOps 2024-06-11T17:20:00.990 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [ RUN ] NeoRadosReadOps.SetOpFlags 2024-06-11T17:20:00.990 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [ OK ] NeoRadosReadOps.SetOpFlags (3064 ms) 2024-06-11T17:20:00.990 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertExists 2024-06-11T17:20:00.990 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertExists (3091 ms) 2024-06-11T17:20:00.990 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertVersion 2024-06-11T17:20:00.993 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertVersion (2784 ms) 2024-06-11T17:20:00.993 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpXattr 2024-06-11T17:20:00.993 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpXattr (3016 ms) 2024-06-11T17:20:00.993 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [ RUN ] NeoRadosReadOps.Read 2024-06-11T17:20:00.993 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [ OK ] NeoRadosReadOps.Read (2983 ms) 2024-06-11T17:20:00.993 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [ RUN ] NeoRadosReadOps.Checksum 2024-06-11T17:20:00.993 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [ OK ] NeoRadosReadOps.Checksum (3024 ms) 2024-06-11T17:20:00.993 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [ RUN ] NeoRadosReadOps.RWOrderedRead 2024-06-11T17:20:00.993 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [ OK ] NeoRadosReadOps.RWOrderedRead (3009 ms) 2024-06-11T17:20:00.994 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [ RUN ] NeoRadosReadOps.ShortRead 2024-06-11T17:20:00.994 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [ OK ] NeoRadosReadOps.ShortRead (3003 ms) 2024-06-11T17:20:00.994 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [ RUN ] NeoRadosReadOps.Exec 2024-06-11T17:20:00.994 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [ OK ] NeoRadosReadOps.Exec (3014 ms) 2024-06-11T17:20:00.994 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [ RUN ] NeoRadosReadOps.Stat 2024-06-11T17:20:00.994 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [ OK ] NeoRadosReadOps.Stat (3072 ms) 2024-06-11T17:20:00.994 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [ RUN ] NeoRadosReadOps.Omap 2024-06-11T17:20:00.994 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [ OK ] NeoRadosReadOps.Omap (2944 ms) 2024-06-11T17:20:00.994 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [ RUN ] NeoRadosReadOps.OmapNuls 2024-06-11T17:20:00.994 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [ OK ] NeoRadosReadOps.OmapNuls (3041 ms) 2024-06-11T17:20:00.994 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [ RUN ] NeoRadosReadOps.GetXattrs 2024-06-11T17:20:00.994 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [ OK ] NeoRadosReadOps.GetXattrs (2930 ms) 2024-06-11T17:20:00.995 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpExt 2024-06-11T17:20:00.995 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpExt (3028 ms) 2024-06-11T17:20:00.995 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [----------] 14 tests from NeoRadosReadOps (42003 ms total) 2024-06-11T17:20:00.995 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: 2024-06-11T17:20:00.995 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [----------] Global test environment tear-down 2024-06-11T17:20:00.995 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [==========] 14 tests from 1 test suite ran. (42003 ms total) 2024-06-11T17:20:00.995 INFO:tasks.workunit.client.0.smithi130.stdout: read_operations: [ PASSED ] 14 tests. 2024-06-11T17:20:00.995 INFO:tasks.workunit.client.0.smithi130.stdout: io: Running main() from gmock_main.cc 2024-06-11T17:20:00.996 INFO:tasks.workunit.client.0.smithi130.stdout: io: [==========] Running 14 tests from 1 test suite. 2024-06-11T17:20:00.996 INFO:tasks.workunit.client.0.smithi130.stdout: io: [----------] Global test environment set-up. 2024-06-11T17:20:00.996 INFO:tasks.workunit.client.0.smithi130.stdout: io: [----------] 14 tests from NeoRadosIo 2024-06-11T17:20:00.996 INFO:tasks.workunit.client.0.smithi130.stdout: io: [ RUN ] NeoRadosIo.Limits 2024-06-11T17:20:00.996 INFO:tasks.workunit.client.0.smithi130.stdout: io: [ OK ] NeoRadosIo.Limits (3123 ms) 2024-06-11T17:20:00.996 INFO:tasks.workunit.client.0.smithi130.stdout: io: [ RUN ] NeoRadosIo.SimpleWrite 2024-06-11T17:20:00.996 INFO:tasks.workunit.client.0.smithi130.stdout: io: [ OK ] NeoRadosIo.SimpleWrite (3052 ms) 2024-06-11T17:20:00.996 INFO:tasks.workunit.client.0.smithi130.stdout: io: [ RUN ] NeoRadosIo.ReadOp 2024-06-11T17:20:00.996 INFO:tasks.workunit.client.0.smithi130.stdout: io: [ OK ] NeoRadosIo.ReadOp (2815 ms) 2024-06-11T17:20:00.996 INFO:tasks.workunit.client.0.smithi130.stdout: io: [ RUN ] NeoRadosIo.SparseRead 2024-06-11T17:20:00.996 INFO:tasks.workunit.client.0.smithi130.stdout: io: [ OK ] NeoRadosIo.SparseRead (3011 ms) 2024-06-11T17:20:00.996 INFO:tasks.workunit.client.0.smithi130.stdout: io: [ RUN ] NeoRadosIo.RoundTrip 2024-06-11T17:20:00.997 INFO:tasks.workunit.client.0.smithi130.stdout: io: [ OK ] NeoRadosIo.RoundTrip (2986 ms) 2024-06-11T17:20:00.997 INFO:tasks.workunit.client.0.smithi130.stdout: io: [ RUN ] NeoRadosIo.ReadIntoBuufferlist 2024-06-11T17:20:00.997 INFO:tasks.workunit.client.0.smithi130.stdout: io: [ OK ] NeoRadosIo.ReadIntoBuufferlist (3034 ms) 2024-06-11T17:20:00.997 INFO:tasks.workunit.client.0.smithi130.stdout: io: [ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2024-06-11T17:20:00.997 INFO:tasks.workunit.client.0.smithi130.stdout: io: [ OK ] NeoRadosIo.OverlappingWriteRoundTrip (3000 ms) 2024-06-11T17:20:00.997 INFO:tasks.workunit.client.0.smithi130.stdout: io: [ RUN ] NeoRadosIo.WriteFullRoundTrip 2024-06-11T17:20:00.997 INFO:tasks.workunit.client.0.smithi130.stdout: io: [ OK ] NeoRadosIo.WriteFullRoundTrip (3013 ms) 2024-06-11T17:20:00.997 INFO:tasks.workunit.client.0.smithi130.stdout: io: [ RUN ] NeoRadosIo.AppendRoundTrip 2024-06-11T17:20:00.997 INFO:tasks.workunit.client.0.smithi130.stdout: io: [ OK ] NeoRadosIo.AppendRoundTrip (3011 ms) 2024-06-11T17:20:00.997 INFO:tasks.workunit.client.0.smithi130.stdout: io: [ RUN ] NeoRadosIo.Trunc 2024-06-11T17:20:00.997 INFO:tasks.workunit.client.0.smithi130.stdout: io: [ OK ] NeoRadosIo.Trunc (3064 ms) 2024-06-11T17:20:00.997 INFO:tasks.workunit.client.0.smithi130.stdout: io: [ RUN ] NeoRadosIo.Remove 2024-06-11T17:20:00.997 INFO:tasks.workunit.client.0.smithi130.stdout: io: [ OK ] NeoRadosIo.Remove (2937 ms) 2024-06-11T17:20:00.998 INFO:tasks.workunit.client.0.smithi130.stdout: io: [ RUN ] NeoRadosIo.XattrsRoundTrip 2024-06-11T17:20:00.998 INFO:tasks.workunit.client.0.smithi130.stdout: io: [ OK ] NeoRadosIo.XattrsRoundTrip (3049 ms) 2024-06-11T17:20:00.998 INFO:tasks.workunit.client.0.smithi130.stdout: io: [ RUN ] NeoRadosIo.RmXattr 2024-06-11T17:20:00.998 INFO:tasks.workunit.client.0.smithi130.stdout: io: [ OK ] NeoRadosIo.RmXattr (2931 ms) 2024-06-11T17:20:00.998 INFO:tasks.workunit.client.0.smithi130.stdout: io: [ RUN ] NeoRadosIo.GetXattrs 2024-06-11T17:20:00.998 INFO:tasks.workunit.client.0.smithi130.stdout: io: [ OK ] NeoRadosIo.GetXattrs (3037 ms) 2024-06-11T17:20:00.998 INFO:tasks.workunit.client.0.smithi130.stdout: io: [----------] 14 tests from NeoRadosIo (42064 ms total) 2024-06-11T17:20:00.998 INFO:tasks.workunit.client.0.smithi130.stdout: io: 2024-06-11T17:20:00.998 INFO:tasks.workunit.client.0.smithi130.stdout: io: [----------] Global test environment tear-down 2024-06-11T17:20:00.998 INFO:tasks.workunit.client.0.smithi130.stdout: io: [==========] 14 tests from 1 test suite ran. (42064 ms total) 2024-06-11T17:20:00.998 INFO:tasks.workunit.client.0.smithi130.stdout: io: [ PASSED ] 14 tests. 2024-06-11T17:20:13.957 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: Running main() from gmock_main.cc 2024-06-11T17:20:13.957 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [==========] Running 13 tests from 4 test suites. 2024-06-11T17:20:13.957 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [----------] Global test environment set-up. 2024-06-11T17:20:13.958 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2024-06-11T17:20:13.958 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2024-06-11T17:20:13.958 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (2034 ms) 2024-06-11T17:20:13.958 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2024-06-11T17:20:13.958 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (1995 ms) 2024-06-11T17:20:13.958 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2024-06-11T17:20:13.958 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (2030 ms) 2024-06-11T17:20:13.958 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2024-06-11T17:20:13.958 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (1803 ms) 2024-06-11T17:20:13.958 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (7862 ms total) 2024-06-11T17:20:13.958 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: 2024-06-11T17:20:13.958 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged 2024-06-11T17:20:13.958 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2024-06-11T17:20:13.959 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (4109 ms) 2024-06-11T17:20:13.959 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2024-06-11T17:20:13.959 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (4111 ms) 2024-06-11T17:20:13.959 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2024-06-11T17:20:13.959 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (4938 ms) 2024-06-11T17:20:13.959 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged (13158 ms total) 2024-06-11T17:20:13.959 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: 2024-06-11T17:20:13.959 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2024-06-11T17:20:13.959 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2024-06-11T17:20:13.959 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapList (3145 ms) 2024-06-11T17:20:13.959 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2024-06-11T17:20:13.959 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapRemove (1793 ms) 2024-06-11T17:20:13.959 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2024-06-11T17:20:13.959 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.Rollback (2029 ms) 2024-06-11T17:20:13.960 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2024-06-11T17:20:13.960 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapGetName (1940 ms) 2024-06-11T17:20:13.960 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (8907 ms total) 2024-06-11T17:20:13.960 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: 2024-06-11T17:20:13.960 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2024-06-11T17:20:13.960 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2024-06-11T17:20:13.960 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Snap (4045 ms) 2024-06-11T17:20:13.960 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-06-11T17:20:13.960 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Rollback (4039 ms) 2024-06-11T17:20:13.960 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (8084 ms total) 2024-06-11T17:20:13.960 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: 2024-06-11T17:20:13.960 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [----------] Global test environment tear-down 2024-06-11T17:20:13.960 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [==========] 13 tests from 4 test suites ran. (55272 ms total) 2024-06-11T17:20:13.960 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots: [ PASSED ] 13 tests. 2024-06-11T17:20:28.952 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: Running main() from gmock_main.cc 2024-06-11T17:20:28.952 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [==========] Running 21 tests from 5 test suites. 2024-06-11T17:20:28.952 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2024-06-11T17:20:28.953 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2024-06-11T17:20:28.953 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: seed 31763 2024-06-11T17:20:28.953 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2024-06-11T17:20:28.953 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (2019 ms) 2024-06-11T17:20:28.953 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2024-06-11T17:20:28.953 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (2043 ms) 2024-06-11T17:20:28.953 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2024-06-11T17:20:28.953 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (2007 ms) 2024-06-11T17:20:28.953 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2024-06-11T17:20:28.953 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (1818 ms) 2024-06-11T17:20:28.954 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2024-06-11T17:20:28.954 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (3983 ms) 2024-06-11T17:20:28.954 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (11871 ms total) 2024-06-11T17:20:28.954 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: 2024-06-11T17:20:28.954 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2024-06-11T17:20:28.954 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2024-06-11T17:20:28.954 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (4177 ms) 2024-06-11T17:20:28.954 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-06-11T17:20:28.954 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (3852 ms) 2024-06-11T17:20:28.954 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-06-11T17:20:28.954 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (6087 ms) 2024-06-11T17:20:28.954 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2024-06-11T17:20:28.955 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (3938 ms) 2024-06-11T17:20:28.955 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2024-06-11T17:20:28.955 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (2116 ms) 2024-06-11T17:20:28.955 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-06-11T17:20:28.955 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: ./src/test/librados/snapshots_cxx.cc:460: Skipped 2024-06-11T17:20:28.955 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: 2024-06-11T17:20:28.955 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2024-06-11T17:20:28.955 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2024-06-11T17:20:28.955 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: deleting snap 14 in pool LibRadosSnapshotsSelfManagedPP_smithi130-31763-7 2024-06-11T17:20:28.955 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: waiting for snaps to purge 2024-06-11T17:20:28.955 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (17886 ms) 2024-06-11T17:20:28.955 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP (38056 ms total) 2024-06-11T17:20:28.955 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: 2024-06-11T17:20:28.955 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2024-06-11T17:20:28.956 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2024-06-11T17:20:28.956 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (14 ms) 2024-06-11T17:20:28.956 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2024-06-11T17:20:28.956 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (4997 ms) 2024-06-11T17:20:28.956 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (5017 ms total) 2024-06-11T17:20:28.956 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: 2024-06-11T17:20:28.956 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2024-06-11T17:20:28.956 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2024-06-11T17:20:28.956 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapListPP (3002 ms) 2024-06-11T17:20:28.956 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2024-06-11T17:20:28.956 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapRemovePP (1975 ms) 2024-06-11T17:20:28.956 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2024-06-11T17:20:28.956 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.RollbackPP (2007 ms) 2024-06-11T17:20:30.974 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_ api_misc_pp: [==========] Running 31 tests from 7 test suites. 2024-06-11T17:20:30.975 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [----------] Global test environment set-up. 2024-06-11T17:20:30.975 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2024-06-11T17:20:30.975 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2024-06-11T17:20:30.975 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2024-06-11T17:20:30.975 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-06-11T17:20:30.975 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: 2024-06-11T17:20:30.975 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP 2024-06-11T17:20:30.975 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: seed 31649 2024-06-11T17:20:30.975 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2024-06-11T17:20:30.975 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (0 ms) 2024-06-11T17:20:30.975 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2024-06-11T17:20:30.975 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (261 ms) 2024-06-11T17:20:30.975 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2024-06-11T17:20:30.976 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (21 ms) 2024-06-11T17:20:30.976 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2024-06-11T17:20:30.976 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (17 ms) 2024-06-11T17:20:30.976 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2024-06-11T17:20:30.976 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (11 ms) 2024-06-11T17:20:30.976 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2024-06-11T17:20:30.976 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (4 ms) 2024-06-11T17:20:30.976 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2024-06-11T17:20:30.976 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (5 ms) 2024-06-11T17:20:30.976 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2024-06-11T17:20:30.976 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (13 ms) 2024-06-11T17:20:30.976 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2024-06-11T17:20:30.976 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (3 ms) 2024-06-11T17:20:30.976 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2024-06-11T17:20:30.977 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (25 ms) 2024-06-11T17:20:30.977 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2024-06-11T17:20:30.977 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (5 ms) 2024-06-11T17:20:30.977 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2024-06-11T17:20:30.977 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (11 ms) 2024-06-11T17:20:30.977 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2024-06-11T17:20:30.977 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (8 ms) 2024-06-11T17:20:30.977 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2024-06-11T17:20:30.977 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: osd_max_attr_size = 0 2024-06-11T17:20:30.977 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2024-06-11T17:20:30.977 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (3954 ms) 2024-06-11T17:20:30.977 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2024-06-11T17:20:30.977 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyPP (571 ms) 2024-06-11T17:20:30.977 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2024-06-11T17:20:30.977 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: waiting for initial deep scrubs... 2024-06-11T17:20:30.978 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: done waiting, doing copies 2024-06-11T17:20:30.978 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: waiting for final deep scrubs... 2024-06-11T17:20:30.978 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: done waiting 2024-06-11T17:20:30.978 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyScrubPP (60958 ms) 2024-06-11T17:20:30.978 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2024-06-11T17:20:30.978 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (15 ms) 2024-06-11T17:20:30.978 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2024-06-11T17:20:30.978 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (9 ms) 2024-06-11T17:20:30.978 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2024-06-11T17:20:30.978 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (4058 ms) 2024-06-11T17:20:30.978 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2024-06-11T17:20:30.978 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2024-06-11T17:20:30.978 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2024-06-11T17:20:30.979 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2024-06-11T17:20:30.979 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2024-06-11T17:20:30.979 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (0 ms) 2024-06-11T17:20:33.955 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [----------] 22 tests from LibRadosMis snapshots: Running main() from gmock_main.cc 2024-06-11T17:20:33.955 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: [==========] Running 11 tests from 2 test suites. 2024-06-11T17:20:33.955 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: [----------] Global test environment set-up. 2024-06-11T17:20:33.956 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots 2024-06-11T17:20:33.956 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapList 2024-06-11T17:20:33.956 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapList (5083 ms) 2024-06-11T17:20:33.956 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapRemove 2024-06-11T17:20:33.956 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapRemove (4829 ms) 2024-06-11T17:20:33.956 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: [ RUN ] NeoRadosSnapshots.Rollback 2024-06-11T17:20:33.956 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: [ OK ] NeoRadosSnapshots.Rollback (4016 ms) 2024-06-11T17:20:33.956 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapGetName 2024-06-11T17:20:33.956 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapGetName (5023 ms) 2024-06-11T17:20:33.956 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapCreateRemove 2024-06-11T17:20:33.956 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapCreateRemove (7021 ms) 2024-06-11T17:20:33.956 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots (25972 ms total) 2024-06-11T17:20:33.956 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: 2024-06-11T17:20:33.956 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps 2024-06-11T17:20:33.956 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Snap 2024-06-11T17:20:33.957 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Snap (5088 ms) 2024-06-11T17:20:33.957 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Rollback 2024-06-11T17:20:33.957 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Rollback (5978 ms) 2024-06-11T17:20:33.957 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2024-06-11T17:20:33.957 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (7922 ms) 2024-06-11T17:20:33.957 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2024-06-11T17:20:33.957 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Bug11677 (6026 ms) 2024-06-11T17:20:33.957 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2024-06-11T17:20:33.957 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.OrderSnap (3983 ms) 2024-06-11T17:20:33.957 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2024-06-11T17:20:33.957 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: Deleting snap 3 in pool ReusePurgedSnapsmithi130-32509-11. 2024-06-11T17:20:33.957 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: Waiting for snaps to purge. 2024-06-11T17:20:33.957 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (20005 ms) 2024-06-11T17:20:33.957 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps (49002 ms total) 2024-06-11T17:20:33.958 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: 2024-06-11T17:20:33.958 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: [----------] Global test environment tear-down 2024-06-11T17:20:33.958 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: [==========] 11 tests from 2 test suites ran. (74974 ms total) 2024-06-11T17:20:33.958 INFO:tasks.workunit.client.0.smithi130.stdout: snapshots: [ PASSED ] 11 tests. 2024-06-11T17:20:39.149 INFO:tasks.workunit.client.0.smithi130.stdout:or()=9:bd63b0f1:::8:head expected=9:bd63b0f1:::8:head 2024-06-11T17:20:39.149 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > 9:bd63b0f1:::8:head -> 8 2024-06-11T17:20:39.149 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : entry=8 expected=8 2024-06-11T17:20:39.149 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : seek to 9:b29083e3:::5:head 2024-06-11T17:20:39.150 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : cursor()=9:b29083e3:::5:head expected=9:b29083e3:::5:head 2024-06-11T17:20:39.150 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > 9:b29083e3:::5:head -> 5 2024-06-11T17:20:39.150 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : entry=5 expected=5 2024-06-11T17:20:39.150 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : seek to 9:89d3ae78:::11:head 2024-06-11T17:20:39.150 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : cursor()=9:89d3ae78:::11:head expected=9:89d3ae78:::11:head 2024-06-11T17:20:39.150 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > 9:89d3ae78:::11:head -> 11 2024-06-11T17:20:39.150 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : entry=11 expected=11 2024-06-11T17:20:39.150 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : seek to 9:863748b0:::15:head 2024-06-11T17:20:39.150 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : cursor()=9:863748b0:::15:head expected=9:863748b0:::15:head 2024-06-11T17:20:39.150 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > 9:863748b0:::15:head -> 15 2024-06-11T17:20:39.150 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : entry=15 expected=15 2024-06-11T17:20:39.150 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : seek to 9:62a1935d:::14:head 2024-06-11T17:20:39.150 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : cursor()=9:62a1935d:::14:head expected=9:62a1935d:::14:head 2024-06-11T17:20:39.151 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > 9:62a1935d:::14:head -> 14 2024-06-11T17:20:39.151 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : entry=14 expected=14 2024-06-11T17:20:39.151 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : seek to 9:5c6b0b28:::7:head 2024-06-11T17:20:39.151 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : cursor()=9:5c6b0b28:::7:head expected=9:5c6b0b28:::7:head 2024-06-11T17:20:39.151 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > 9:5c6b0b28:::7:head -> 7 2024-06-11T17:20:39.151 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : entry=7 expected=7 2024-06-11T17:20:39.151 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : seek to 9:566253c9:::13:head 2024-06-11T17:20:39.151 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : cursor()=9:566253c9:::13:head expected=9:566253c9:::13:head 2024-06-11T17:20:39.151 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > 9:566253c9:::13:head -> 13 2024-06-11T17:20:39.151 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : entry=13 expected=13 2024-06-11T17:20:39.151 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : seek to 9:52ea6a34:::10:head 2024-06-11T17:20:39.151 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : cursor()=9:52ea6a34:::10:head expected=9:52ea6a34:::10:head 2024-06-11T17:20:39.151 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: > 9:52ea6a34:::10:head -> 10 2024-06-11T17:20:39.151 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: : entry=10 expected=10 2024-06-11T17:20:39.152 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: [ OK ] LibRadosList.ListObjectsCursor (263 ms) 2024-06-11T17:20:39.152 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjects 2024-06-11T17:20:39.152 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: [ OK ] LibRadosList.EnumerateObjects (65208 ms) 2024-06-11T17:20:39.152 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjectsSplit 2024-06-11T17:20:39.152 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: split 0/5 -> MIN 9:33333333::::head 2024-06-11T17:20:39.152 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: split 1/5 -> 9:33333333::::head 9:66666666::::head 2024-06-11T17:20:39.152 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: split 2/5 -> 9:66666666::::head 9:99999999::::head 2024-06-11T17:20:39.152 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: split 3/5 -> 9:99999999::::head 9:cccccccc::::head 2024-06-11T17:20:39.152 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: split 4/5 -> 9:cccccccc::::head MAX 2024-06-11T17:20:39.152 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: [ OK ] LibRadosList.EnumerateObjectsSplit (7953 ms) 2024-06-11T17:20:39.152 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: [----------] 7 tests from LibRadosList (74014 ms total) 2024-06-11T17:20:39.152 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: 2024-06-11T17:20:39.152 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: [----------] 3 tests from LibRadosListEC 2024-06-11T17:20:39.152 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: [ RUN ] LibRadosListEC.ListObjects 2024-06-11T17:20:39.153 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: [ OK ] LibRadosListEC.ListObjects (1057 ms) 2024-06-11T17:20:39.153 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsNS 2024-06-11T17:20:39.153 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: myset foo1,foo2,foo3 2024-06-11T17:20:39.153 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: foo1 2024-06-11T17:20:39.153 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: foo2 2024-06-11T17:20:39.153 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: foo3 2024-06-11T17:20:39.153 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: myset foo1,foo4,foo5 2024-06-11T17:20:39.153 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: foo4 2024-06-11T17:20:39.153 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: foo5 2024-06-11T17:20:39.153 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: foo1 2024-06-11T17:20:39.153 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: myset foo6,foo7 2024-06-11T17:20:39.153 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: foo7 2024-06-11T17:20:39.153 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: foo6 2024-06-11T17:20:39.154 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-06-11T17:20:39.154 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: ns1:foo4 2024-06-11T17:20:39.154 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: ns1:foo5 2024-06-11T17:20:39.154 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: ns2:foo7 2024-06-11T17:20:39.154 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: ns2:foo6 2024-06-11T17:20:39.154 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: ns1:foo1 2024-06-11T17:20:39.154 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: :foo1 2024-06-11T17:20:39.154 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: :foo2 2024-06-11T17:20:39.154 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: :foo3 2024-06-11T17:20:39.154 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsNS (91 ms) 2024-06-11T17:20:39.154 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsStart 2024-06-11T17:20:39.154 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: 1 0 2024-06-11T17:20:39.155 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: 10 0 2024-06-11T17:20:39.155 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: 13 0 2024-06-11T17:20:42.974 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: api_aio: Running main() from gmock_main.cc 2024-06-11T17:20:42.975 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [==========] Running 42 tests from 2 test suites. 2024-06-11T17:20:42.975 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [----------] Global test environment set-up. 2024-06-11T17:20:42.975 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [----------] 26 tests from LibRadosAio 2024-06-11T17:20:42.975 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2024-06-11T17:20:42.975 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAio.TooBig (2444 ms) 2024-06-11T17:20:42.975 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2024-06-11T17:20:42.975 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (3032 ms) 2024-06-11T17:20:42.975 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2024-06-11T17:20:42.975 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (2828 ms) 2024-06-11T17:20:42.975 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2024-06-11T17:20:42.975 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (3042 ms) 2024-06-11T17:20:42.976 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2024-06-11T17:20:42.976 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (2985 ms) 2024-06-11T17:20:42.976 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2024-06-11T17:20:42.976 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (3008 ms) 2024-06-11T17:20:42.976 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2024-06-11T17:20:42.976 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (3007 ms) 2024-06-11T17:20:42.976 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2024-06-11T17:20:42.976 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (3005 ms) 2024-06-11T17:20:42.976 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2024-06-11T17:20:42.976 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (3022 ms) 2024-06-11T17:20:42.976 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2024-06-11T17:20:42.976 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (3052 ms) 2024-06-11T17:20:42.977 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2024-06-11T17:20:42.977 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (3142 ms) 2024-06-11T17:20:42.977 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2024-06-11T17:20:42.977 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (2836 ms) 2024-06-11T17:20:42.977 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2024-06-11T17:20:42.977 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (2927 ms) 2024-06-11T17:20:42.977 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2024-06-11T17:20:42.977 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (3039 ms) 2024-06-11T17:20:42.977 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2024-06-11T17:20:42.977 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAio.Flush (2973 ms) 2024-06-11T17:20:42.977 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2024-06-11T17:20:42.977 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (3016 ms) 2024-06-11T17:20:42.977 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2024-06-11T17:20:42.978 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (3016 ms) 2024-06-11T17:20:42.978 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2024-06-11T17:20:42.978 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (2979 ms) 2024-06-11T17:20:42.978 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2024-06-11T17:20:42.978 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (3010 ms) 2024-06-11T17:20:42.978 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAio.OperateMtime 2024-06-11T17:20:42.978 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAio.OperateMtime (2996 ms) 2024-06-11T17:20:42.978 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAio.Operate2Mtime 2024-06-11T17:20:42.978 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAio.Operate2Mtime (3012 ms) 2024-06-11T17:20:42.981 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2024-06-11T17:20:42.981 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (3009 ms) 2024-06-11T17:20:42.981 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2024-06-11T17:20:42.981 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (2981 ms) 2024-06-11T17:20:42.981 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2024-06-11T17:20:42.981 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (3033 ms) 2024-06-11T17:20:42.981 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2024-06-11T17:20:42.981 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (2969 ms) 2024-06-11T17:20:42.982 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2024-06-11T17:20:42.982 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (3033 ms) 2024-06-11T17:20:42.982 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [----------] 26 tests from LibRadosAio (77397 ms total) 2024-06-11T17:20:42.982 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: 2024-06-11T17:20:42.982 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2024-06-11T17:20:42.982 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleWrite 2024-06-11T17:20:45.011 INFO:tasks.workunit.client.0.smithi130.stdout: 7 0 2024-06-11T17:20:45.012 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: 14 0 2024-06-11T17:20:45.012 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: 0 0 2024-06-11T17:20:45.012 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: 15 0 2024-06-11T17:20:45.012 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: 11 0 2024-06-11T17:20:45.012 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: 5 0 2024-06-11T17:20:45.012 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: 8 0 2024-06-11T17:20:45.012 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: 6 0 2024-06-11T17:20:45.012 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: 3 0 2024-06-11T17:20:45.012 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: 4 0 2024-06-11T17:20:45.012 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: 12 0 2024-06-11T17:20:45.012 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: 9 0 2024-06-11T17:20:45.012 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: 2 0 2024-06-11T17:20:45.012 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-06-11T17:20:45.013 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsStart (117 ms) 2024-06-11T17:20:45.013 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: [----------] 3 tests from LibRadosListEC (1265 ms total) 2024-06-11T17:20:45.013 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: 2024-06-11T17:20:45.013 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: [----------] 1 test from LibRadosListNP 2024-06-11T17:20:45.013 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: [ RUN ] LibRadosListNP.ListObjectsError 2024-06-11T17:20:45.013 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: [ OK ] LibRadosListNP.ListObjectsError (3025 ms) 2024-06-11T17:20:45.013 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: [----------] 1 test from LibRadosListNP (3025 ms total) 2024-06-11T17:20:45.013 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: 2024-06-11T17:20:45.013 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: [----------] Global test environment tear-down 2024-06-11T17:20:45.013 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: [==========] 11 tests from 3 test suites ran. (86373 ms total) 2024-06-11T17:20:45.013 INFO:tasks.workunit.client.0.smithi130.stdout: api_list: [ PASSED ] 11 tests. 2024-06-11T17:20:51.982 INFO:tasks.workunit.client.0.smithi130.stdout:pp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-06-11T17:20:51.982 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapGetNamePP (2034 ms) 2024-06-11T17:20:51.982 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (9018 ms total) 2024-06-11T17:20:51.982 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: 2024-06-11T17:20:51.983 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2024-06-11T17:20:51.983 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-06-11T17:20:51.983 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.SnapPP (4061 ms) 2024-06-11T17:20:51.983 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-06-11T17:20:51.983 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (3979 ms) 2024-06-11T17:20:51.983 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-06-11T17:20:51.983 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (3967 ms) 2024-06-11T17:20:51.983 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (12007 ms total) 2024-06-11T17:20:51.983 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: 2024-06-11T17:20:51.983 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2024-06-11T17:20:51.983 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [==========] 21 tests from 5 test suites ran. (93277 ms total) 2024-06-11T17:20:51.983 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ PASSED ] 20 tests. 2024-06-11T17:20:51.983 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ SKIPPED ] 1 test, listed below: 2024-06-11T17:20:51.984 INFO:tasks.workunit.client.0.smithi130.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-06-11T17:20:56.964 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: Running main() from gmock_main.cc 2024-06-11T17:20:56.964 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [==========] Running 57 tests from 4 test suites. 2024-06-11T17:20:56.964 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [----------] Global test environment set-up. 2024-06-11T17:20:56.964 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio 2024-06-11T17:20:56.964 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2024-06-11T17:20:56.964 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (2449 ms) 2024-06-11T17:20:56.964 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2024-06-11T17:20:56.964 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (17902 ms) 2024-06-11T17:20:56.964 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2024-06-11T17:20:56.965 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (6038 ms) 2024-06-11T17:20:56.965 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2024-06-11T17:20:56.965 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (3085 ms) 2024-06-11T17:20:56.965 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2024-06-11T17:20:56.965 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (3118 ms) 2024-06-11T17:20:56.965 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2024-06-11T17:20:56.965 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (2798 ms) 2024-06-11T17:20:56.965 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2024-06-11T17:20:56.965 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (2949 ms) 2024-06-11T17:20:56.965 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2024-06-11T17:20:56.965 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (3031 ms) 2024-06-11T17:20:56.965 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2024-06-11T17:20:56.965 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (2985 ms) 2024-06-11T17:20:56.965 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2024-06-11T17:20:56.966 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (3011 ms) 2024-06-11T17:20:56.966 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2024-06-11T17:20:56.966 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (3008 ms) 2024-06-11T17:20:56.966 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2024-06-11T17:20:56.966 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (2974 ms) 2024-06-11T17:20:56.966 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2024-06-11T17:20:56.966 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (3013 ms) 2024-06-11T17:20:56.966 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2024-06-11T17:20:56.966 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (2991 ms) 2024-06-11T17:20:56.966 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2024-06-11T17:20:56.966 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (3017 ms) 2024-06-11T17:20:56.966 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2024-06-11T17:20:56.966 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (3006 ms) 2024-06-11T17:20:56.966 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2024-06-11T17:20:56.967 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (2993 ms) 2024-06-11T17:20:56.967 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2024-06-11T17:20:56.967 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (3025 ms) 2024-06-11T17:20:56.967 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2024-06-11T17:20:56.967 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (2974 ms) 2024-06-11T17:20:56.967 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime 2024-06-11T17:20:56.967 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime (3027 ms) 2024-06-11T17:20:56.967 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime2 2024-06-11T17:20:56.967 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime2 (2981 ms) 2024-06-11T17:20:56.967 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2024-06-11T17:20:56.967 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (3017 ms) 2024-06-11T17:20:56.968 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2024-06-11T17:20:56.968 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (3015 ms) 2024-06-11T17:20:56.968 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2024-06-11T17:20:56.968 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (2971 ms) 2024-06-11T17:20:56.968 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2024-06-11T17:20:56.968 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (3003 ms) 2024-06-11T17:20:56.968 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2024-06-11T17:20:56.968 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (3015 ms) 2024-06-11T17:20:56.968 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2024-06-11T17:20:56.984 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAiocPP (69949 ms total) 2024-06-11T17:20:56.984 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: 2024-06-11T17:20:56.984 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2024-06-11T17:20:56.984 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2024-06-11T17:20:56.984 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ OK ] LibRadosTwoPoolsECPP.CopyFrom (121 ms) 2024-06-11T17:20:56.984 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (121 ms total) 2024-06-11T17:20:56.984 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: 2024-06-11T17:20:56.984 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2024-06-11T17:20:56.984 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2024-06-11T17:20:56.984 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (55 ms) 2024-06-11T17:20:56.984 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2024-06-11T17:20:56.984 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (9 ms) 2024-06-11T17:20:56.985 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (64 ms total) 2024-06-11T17:20:56.985 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: 2024-06-11T17:20:56.985 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2024-06-11T17:20:56.985 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2024-06-11T17:20:56.985 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (35 ms) 2024-06-11T17:20:56.985 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2024-06-11T17:20:56.985 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (18 ms) 2024-06-11T17:20:56.985 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (53 ms total) 2024-06-11T17:20:56.985 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: 2024-06-11T17:20:56.985 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2024-06-11T17:20:56.985 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2024-06-11T17:20:56.985 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (41 ms) 2024-06-11T17:20:56.985 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2024-06-11T17:20:56.985 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (4 ms) 2024-06-11T17:20:56.986 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (45 ms total) 2024-06-11T17:20:56.986 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: 2024-06-11T17:20:56.986 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2024-06-11T17:20:56.986 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2024-06-11T17:20:56.986 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ OK ] LibRadosMiscECPP.CompareExtentRange (1507 ms) 2024-06-11T17:20:56.986 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (1507 ms total) 2024-06-11T17:20:56.986 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: 2024-06-11T17:20:56.986 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [----------] Global test environment tear-down 2024-06-11T17:20:56.986 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [==========] 31 tests from 7 test suites ran. (98279 ms total) 2024-06-11T17:20:56.986 INFO:tasks.workunit.client.0.smithi130.stdout: api_misc_pp: [ PASSED ] 31 tests. 2024-06-11T17:22:28.040 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleWrite (6995 ms) 2024-06-11T17:22:28.041 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComplete 2024-06-11T17:22:28.041 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAioEC.WaitForComplete (6991 ms) 2024-06-11T17:22:28.041 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip 2024-06-11T17:22:28.041 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip (7000 ms) 2024-06-11T17:22:28.041 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2024-06-11T17:22:28.041 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip2 (7019 ms) 2024-06-11T17:22:28.042 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2024-06-11T17:22:28.042 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripAppend (6986 ms) 2024-06-11T17:22:28.042 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2024-06-11T17:22:28.042 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAioEC.IsComplete (6999 ms) 2024-06-11T17:22:28.042 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2024-06-11T17:22:28.042 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAioEC.IsSafe (7035 ms) 2024-06-11T17:22:28.042 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2024-06-11T17:22:28.042 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAioEC.ReturnValue (6968 ms) 2024-06-11T17:22:28.042 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2024-06-11T17:22:28.042 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAioEC.Flush (7011 ms) 2024-06-11T17:22:28.042 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2024-06-11T17:22:28.042 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAioEC.FlushAsync (7021 ms) 2024-06-11T17:22:28.043 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2024-06-11T17:22:28.043 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripWriteFull (6974 ms) 2024-06-11T17:22:28.043 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2024-06-11T17:22:28.043 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStat (7015 ms) 2024-06-11T17:22:28.043 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2024-06-11T17:22:28.043 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStatNS (6991 ms) 2024-06-11T17:22:28.043 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2024-06-11T17:22:28.043 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAioEC.StatRemove (7053 ms) 2024-06-11T17:22:28.043 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2024-06-11T17:22:28.043 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAioEC.ExecuteClass (6964 ms) 2024-06-11T17:22:28.043 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2024-06-11T17:22:28.044 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ OK ] LibRadosAioEC.MultiWrite (7032 ms) 2024-06-11T17:22:28.044 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (112054 ms total) 2024-06-11T17:22:28.044 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: 2024-06-11T17:22:28.044 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [----------] Global test environment tear-down 2024-06-11T17:22:28.044 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [==========] 42 tests from 2 test suites ran. (189451 ms total) 2024-06-11T17:22:28.044 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio: [ PASSED ] 42 tests. 2024-06-11T17:22:47.010 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [==========] Running 77 tests from 4 test suites. 2024-06-11T17:22:47.011 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [----------] Global test environment set-up. 2024-06-11T17:22:47.011 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP 2024-06-11T17:22:47.011 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: seed 31677 2024-06-11T17:22:47.011 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.Dirty 2024-06-11T17:22:47.011 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTierPP.Dirty (252 ms) 2024-06-11T17:22:47.011 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.FlushWriteRaces 2024-06-11T17:22:47.011 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTierPP.FlushWriteRaces (10680 ms) 2024-06-11T17:22:47.011 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.HitSetNone 2024-06-11T17:22:47.011 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTierPP.HitSetNone (34 ms) 2024-06-11T17:22:47.011 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP (10966 ms total) 2024-06-11T17:22:47.011 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: 2024-06-11T17:22:47.011 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP 2024-06-11T17:22:47.011 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Overlay 2024-06-11T17:22:47.012 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Overlay (7120 ms) 2024-06-11T17:22:47.012 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Promote 2024-06-11T17:22:47.012 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Promote (7996 ms) 2024-06-11T17:22:47.012 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2024-06-11T17:22:47.012 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnap (9931 ms) 2024-06-11T17:22:47.012 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-06-11T17:22:47.012 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: my_snaps [3] 2024-06-11T17:22:47.012 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: my_snaps [4,3] 2024-06-11T17:22:47.012 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: my_snaps [5,4,3] 2024-06-11T17:22:47.012 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: my_snaps [6,5,4,3] 2024-06-11T17:22:47.012 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: promoting some heads 2024-06-11T17:22:47.012 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: promoting from clones for snap 6 2024-06-11T17:22:47.012 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: promoting from clones for snap 5 2024-06-11T17:22:47.012 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: promoting from clones for snap 4 2024-06-11T17:22:47.012 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: promoting from clones for snap 3 2024-06-11T17:22:47.013 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: waiting for scrubs... 2024-06-11T17:22:47.013 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: done waiting 2024-06-11T17:22:47.013 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapScrub (47037 ms) 2024-06-11T17:22:47.013 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-06-11T17:22:47.013 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (10029 ms) 2024-06-11T17:22:47.013 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Whiteout 2024-06-11T17:22:47.013 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Whiteout (7967 ms) 2024-06-11T17:22:47.013 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-06-11T17:22:47.013 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (7990 ms) 2024-06-11T17:22:47.013 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Evict 2024-06-11T17:22:47.013 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Evict (8028 ms) 2024-06-11T17:22:47.013 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap 2024-06-11T17:22:47.013 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap (9977 ms) 2024-06-11T17:22:47.013 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2024-06-11T17:22:47.014 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap2 (9003 ms) 2024-06-11T17:22:47.014 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ListSnap 2024-06-11T17:22:47.014 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ListSnap (10003 ms) 2024-06-11T17:22:47.014 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-06-11T17:22:47.014 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (13055 ms) 2024-06-11T17:22:47.014 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlush 2024-06-11T17:22:47.014 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlush (7978 ms) 2024-06-11T17:22:47.014 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Flush 2024-06-11T17:22:47.014 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Flush (7992 ms) 2024-06-11T17:22:47.014 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushSnap 2024-06-11T17:22:47.014 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushSnap (13026 ms) 2024-06-11T17:22:47.014 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-06-11T17:22:47.014 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushTryFlushRaces (8012 ms) 2024-06-11T17:22:47.014 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-06-11T17:22:47.014 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlushReadRace (7968 ms) 2024-06-11T17:23:02.685 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetRead 2024-06-11T17:23:02.686 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: hmm, no HitSet yet 2024-06-11T17:23:02.686 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: ok, hit_set contains 270:602f83fe:::foo:head 2024-06-11T17:23:02.686 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetRead (9051 ms) 2024-06-11T17:23:02.686 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2024-06-11T17:23:02.686 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: pg_num = 32 2024-06-11T17:23:02.686 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: pg 0 ls 1718126583,0 2024-06-11T17:23:02.686 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: pg 1 ls 1718126583,0 2024-06-11T17:23:02.686 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: pg 2 ls 1718126583,0 2024-06-11T17:23:02.686 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: pg 3 ls 1718126583,0 2024-06-11T17:23:02.686 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: pg 4 ls 1718126583,0 2024-06-11T17:23:02.687 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: pg 5 ls 1718126583,0 2024-06-11T17:23:02.687 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: pg 6 ls 1718126583,0 2024-06-11T17:23:02.687 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: pg 7 ls 1718126583,0 2024-06-11T17:23:02.687 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: pg 8 ls 1718126583,0 2024-06-11T17:23:02.687 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: pg 9 ls 1718126583,0 2024-06-11T17:23:02.687 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: pg 10 ls 1718126583,0 2024-06-11T17:23:02.687 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: pg 11 ls 1718126583,0 2024-06-11T17:23:02.687 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: pg 12 ls 1718126583,0 2024-06-11T17:23:02.687 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: pg 13 ls 1718126583,0 2024-06-11T17:23:02.687 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: pg 14 ls 1718126583,0 2024-06-11T17:23:02.687 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: pg 15 ls 1718126583,0 2024-06-11T17:23:02.687 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: pg 16 ls 1718126583,0 2024-06-11T17:23:02.687 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: pg 17 ls 1718126583,0 2024-06-11T17:23:02.687 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: pg 18 ls 1718126583,0 2024-06-11T17:23:02.688 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: pg 19 ls 1718126583,0 2024-06-11T17:23:02.688 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: pg 20 ls 1718126583,0 2024-06-11T17:23:02.688 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: pg 21 ls 1718126583,0 2024-06-11T17:23:02.688 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: pg 22 ls 1718126583,0 2024-06-11T17:23:02.688 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: pg 23 ls 1718126583,0 2024-06-11T17:23:02.688 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: pg 24 ls 1718126583,0 2024-06-11T17:23:02.688 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: pg 25 ls 1718126583,0 2024-06-11T17:23:02.688 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: pg 26 ls 1718126583,0 2024-06-11T17:23:02.688 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: pg 27 ls 1718126583,0 2024-06-11T17:23:02.688 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: pg 28 ls 1718126583,0 2024-06-11T17:23:02.688 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: pg 29 ls 1718126583,0 2024-06-11T17:23:02.688 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: pg 30 ls 1718126583,0 2024-06-11T17:23:02.688 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: pg 31 ls 1718126583,0 2024-06-11T17:23:02.689 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: pg_num = 32 2024-06-11T17:23:02.689 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:6cac518f:::0:head 2024-06-11T17:23:02.689 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:02547ec2:::1:head 2024-06-11T17:23:02.689 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:f905c69b:::2:head 2024-06-11T17:23:02.689 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:cfc208b3:::3:head 2024-06-11T17:23:02.689 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:d83876eb:::4:head 2024-06-11T17:23:02.689 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:b29083e3:::5:head 2024-06-11T17:23:02.689 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:c4fdafeb:::6:head 2024-06-11T17:23:02.689 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:5c6b0b28:::7:head 2024-06-11T17:23:02.689 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:bd63b0f1:::8:head 2024-06-11T17:23:02.689 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:e960b815:::9:head 2024-06-11T17:23:02.689 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:52ea6a34:::10:head 2024-06-11T17:23:02.689 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:89d3ae78:::11:head 2024-06-11T17:23:02.690 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:de5d7c5f:::12:head 2024-06-11T17:23:02.690 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:566253c9:::13:head 2024-06-11T17:23:02.690 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:62a1935d:::14:head 2024-06-11T17:23:02.690 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:863748b0:::15:head 2024-06-11T17:23:02.690 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:3958e169:::16:head 2024-06-11T17:23:02.690 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:4d4dabf9:::17:head 2024-06-11T17:23:02.690 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:8391935d:::18:head 2024-06-11T17:23:02.690 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:28883081:::19:head 2024-06-11T17:23:02.690 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:69259c59:::20:head 2024-06-11T17:23:02.690 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:4bdb80b7:::21:head 2024-06-11T17:23:02.690 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:a11c5d71:::22:head 2024-06-11T17:23:02.690 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:271af37b:::23:head 2024-06-11T17:23:02.690 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:95b121be:::24:head 2024-06-11T17:23:02.691 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:58d1031b:::25:head 2024-06-11T17:23:02.691 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:0a050783:::26:head 2024-06-11T17:23:02.691 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:c709704c:::27:head 2024-06-11T17:23:02.691 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:cbe56eaf:::28:head 2024-06-11T17:23:02.691 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:86b4b162:::29:head 2024-06-11T17:23:02.691 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:70d89383:::30:head 2024-06-11T17:23:02.691 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:dd450c7c:::31:head 2024-06-11T17:23:02.691 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:6d5729b1:::32:head 2024-06-11T17:23:02.691 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:c388f3fb:::33:head 2024-06-11T17:23:02.691 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:56cfea31:::34:head 2024-06-11T17:23:02.691 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:9dbc1bf7:::35:head 2024-06-11T17:23:02.691 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:40b74ccd:::36:head 2024-06-11T17:23:02.691 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:4d5aaf42:::37:head 2024-06-11T17:23:02.691 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:920f362c:::38:head 2024-06-11T17:23:02.692 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:6cc53222:::39:head 2024-06-11T17:23:02.692 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:9cad833f:::40:head 2024-06-11T17:23:02.692 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:1ea84d41:::41:head 2024-06-11T17:23:02.692 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:c4480ef6:::42:head 2024-06-11T17:23:02.692 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:a694361e:::43:head 2024-06-11T17:23:02.692 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:d1bd33e9:::44:head 2024-06-11T17:23:02.692 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:ddc2cd5d:::45:head 2024-06-11T17:23:02.692 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:2b782207:::46:head 2024-06-11T17:23:02.692 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:7b187fca:::47:head 2024-06-11T17:23:02.692 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:90ecdf6f:::48:head 2024-06-11T17:23:02.692 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:a5ed95fe:::49:head 2024-06-11T17:23:02.692 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:ea0eaa55:::50:head 2024-06-11T17:23:02.693 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:f33ef17b:::51:head 2024-06-11T17:23:02.693 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:a0d1b2f6:::52:head 2024-06-11T17:23:02.693 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:60c5229e:::53:head 2024-06-11T17:23:02.693 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:edcbc575:::54:head 2024-06-11T17:23:02.693 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:102cf253:::55:head 2024-06-11T17:23:02.693 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:efb7fb0b:::56:head 2024-06-11T17:23:02.693 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:50d0a326:::57:head 2024-06-11T17:23:02.693 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:d4dc5daf:::58:head 2024-06-11T17:23:02.693 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:3a130462:::59:head 2024-06-11T17:23:02.693 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:ec87ed71:::60:head 2024-06-11T17:23:02.693 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:d5bc9454:::61:head 2024-06-11T17:23:02.693 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:3ddfe313:::62:head 2024-06-11T17:23:02.693 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:7c2816b9:::63:head 2024-06-11T17:23:02.693 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:47e00e4d:::64:head 2024-06-11T17:23:02.693 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:c6410c18:::65:head 2024-06-11T17:23:02.694 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:b48ed237:::66:head 2024-06-11T17:23:02.694 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:cd63ad31:::67:head 2024-06-11T17:23:02.694 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:b179e92b:::68:head 2024-06-11T17:23:02.694 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:0d9f741a:::69:head 2024-06-11T17:23:02.694 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:6d3352ae:::70:head 2024-06-11T17:23:02.694 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:c6d5c19e:::71:head 2024-06-11T17:23:02.694 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:bc4729c3:::72:head 2024-06-11T17:23:02.694 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:77e930b9:::73:head 2024-06-11T17:23:02.694 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:0abeecfd:::74:head 2024-06-11T17:23:02.694 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:b7c37e15:::75:head 2024-06-11T17:23:02.694 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:b6378398:::76:head 2024-06-11T17:23:02.694 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:02bd68de:::77:head 2024-06-11T17:23:02.694 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:cc795d2d:::78:head 2024-06-11T17:23:02.694 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:630d4fea:::79:head 2024-06-11T17:23:02.695 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:e0d29ef5:::80:head 2024-06-11T17:23:02.695 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:fd6f13d2:::81:head 2024-06-11T17:23:02.695 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:606461d5:::82:head 2024-06-11T17:23:02.695 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:eadbdc43:::83:head 2024-06-11T17:23:02.695 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:8761d0bb:::84:head 2024-06-11T17:23:02.695 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:9ef0186f:::85:head 2024-06-11T17:23:02.695 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:e0d41294:::86:head 2024-06-11T17:23:02.695 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:961de695:::87:head 2024-06-11T17:23:02.695 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:1423148f:::88:head 2024-06-11T17:23:02.695 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:633a8fa2:::89:head 2024-06-11T17:23:02.695 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:a8653809:::90:head 2024-06-11T17:23:02.695 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:3dac8b33:::91:head 2024-06-11T17:23:02.695 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:35aad435:::92:head 2024-06-11T17:23:02.695 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:f6dcc343:::93:head 2024-06-11T17:23:02.695 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:dbbdad87:::94:head 2024-06-11T17:23:02.696 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:1cb48ce0:::95:head 2024-06-11T17:23:02.696 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:03cd461c:::96:head 2024-06-11T17:23:02.696 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:17a4ea99:::97:head 2024-06-11T17:23:02.696 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:9993c9a7:::98:head 2024-06-11T17:23:02.696 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:6394211c:::99:head 2024-06-11T17:23:02.696 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:94c7ae57:::100:head 2024-06-11T17:23:02.697 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:6fdee5bb:::101:head 2024-06-11T17:23:02.697 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:9a477fd1:::102:head 2024-06-11T17:23:02.697 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:eb850916:::103:head 2024-06-11T17:23:02.697 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:affc56b9:::104:head 2024-06-11T17:23:02.697 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:b42dc814:::105:head 2024-06-11T17:23:02.697 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:f319f8f0:::106:head 2024-06-11T17:23:02.697 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:9a40b9de:::107:head 2024-06-11T17:23:02.697 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:8b524f28:::108:head 2024-06-11T17:23:02.697 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:e3de589f:::109:head 2024-06-11T17:23:02.697 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:90f90a5b:::110:head 2024-06-11T17:23:02.697 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:a7b4f1d7:::111:head 2024-06-11T17:23:02.697 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:af51766e:::112:head 2024-06-11T17:23:02.697 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:b6f90bd1:::113:head 2024-06-11T17:23:02.697 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:e0261208:::114:head 2024-06-11T17:23:02.697 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:c9569ef7:::115:head 2024-06-11T17:23:02.698 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:61bebe50:::116:head 2024-06-11T17:23:02.698 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:fe93412b:::117:head 2024-06-11T17:23:02.698 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:d3d38bee:::118:head 2024-06-11T17:23:02.698 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:3100ba0c:::119:head 2024-06-11T17:23:02.698 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:d0560ada:::120:head 2024-06-11T17:23:02.698 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:f0ea8b35:::121:head 2024-06-11T17:23:02.698 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:766f231a:::122:head 2024-06-11T17:23:02.698 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:a07a2582:::123:head 2024-06-11T17:23:02.698 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:bd7c6b3a:::124:head 2024-06-11T17:23:02.698 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:fb2ddaff:::125:head 2024-06-11T17:23:02.698 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:4408e1fe:::126:head 2024-06-11T17:23:02.698 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:ee1df7a7:::127:head 2024-06-11T17:23:02.698 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:c3002909:::128:head 2024-06-11T17:23:02.698 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:4f48ffa9:::129:head 2024-06-11T17:23:02.699 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:edf38733:::130:head 2024-06-11T17:23:02.699 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:c08425c0:::131:head 2024-06-11T17:23:02.699 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:5f902d98:::132:head 2024-06-11T17:23:02.699 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:41ea2c93:::133:head 2024-06-11T17:23:02.699 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:813cee13:::134:head 2024-06-11T17:23:02.699 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:0131818d:::135:head 2024-06-11T17:23:02.699 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:26ba5a85:::136:head 2024-06-11T17:23:02.699 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:381b8a5a:::137:head 2024-06-11T17:23:02.700 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:28797e47:::138:head 2024-06-11T17:23:02.700 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:bfca7f22:::139:head 2024-06-11T17:23:02.700 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:36807075:::140:head 2024-06-11T17:23:02.700 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:80b03975:::141:head 2024-06-11T17:23:02.700 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:5c15709b:::142:head 2024-06-11T17:23:02.700 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:f39ea15e:::143:head 2024-06-11T17:23:02.700 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:ea992956:::144:head 2024-06-11T17:23:02.700 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:48887b1c:::145:head 2024-06-11T17:23:02.700 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:9f24a9dd:::146:head 2024-06-11T17:23:02.701 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:987f100b:::147:head 2024-06-11T17:23:02.701 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:d2dd3581:::148:head 2024-06-11T17:23:02.701 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:7fed1808:::149:head 2024-06-11T17:23:02.701 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:c80b70e9:::150:head 2024-06-11T17:23:02.701 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:85ed90f9:::151:head 2024-06-11T17:23:02.701 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:36428b24:::152:head 2024-06-11T17:23:02.701 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:d044c34a:::153:head 2024-06-11T17:23:02.701 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:7c18bf58:::154:head 2024-06-11T17:23:02.702 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:d1c21232:::155:head 2024-06-11T17:23:02.702 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:a7a3c575:::156:head 2024-06-11T17:23:02.702 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:87da0633:::157:head 2024-06-11T17:23:02.702 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:d5ac3822:::158:head 2024-06-11T17:23:02.702 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:3f20522d:::159:head 2024-06-11T17:23:02.702 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:6ca26563:::160:head 2024-06-11T17:23:02.702 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:532ce135:::161:head 2024-06-11T17:23:02.702 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:c78863e6:::162:head 2024-06-11T17:23:23.084 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:7462ddf6:::1.RoundTripAppendPP (2983 ms) 2024-06-11T17:23:23.084 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2024-06-11T17:23:23.084 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAio.RacingRemovePP (2994 ms) 2024-06-11T17:23:23.085 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP 2024-06-11T17:23:23.085 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP (3014 ms) 2024-06-11T17:23:23.085 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP2 2024-06-11T17:23:23.085 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP2 (3026 ms) 2024-06-11T17:23:23.085 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolEIOFlag 2024-06-11T17:23:23.085 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: setting pool EIO 2024-06-11T17:23:23.085 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: max_success 99, min_failed 100 2024-06-11T17:23:23.085 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolEIOFlag (3966 ms) 2024-06-11T17:23:23.085 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiReads 2024-06-11T17:23:23.085 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiReads (3027 ms) 2024-06-11T17:23:23.086 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio (114407 ms total) 2024-06-11T17:23:23.086 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: 2024-06-11T17:23:23.086 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP 2024-06-11T17:23:23.086 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.ReadIntoBufferlist 2024-06-11T17:23:23.086 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAioPP.ReadIntoBufferlist (3016 ms) 2024-06-11T17:23:23.086 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.XattrsRoundTripPP 2024-06-11T17:23:23.086 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAioPP.XattrsRoundTripPP (9000 ms) 2024-06-11T17:23:23.086 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RmXattrPP 2024-06-11T17:23:23.086 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RmXattrPP (14982 ms) 2024-06-11T17:23:23.086 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RemoveTestPP 2024-06-11T17:23:23.086 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RemoveTestPP (3013 ms) 2024-06-11T17:23:23.087 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP (30011 ms total) 2024-06-11T17:23:23.087 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: 2024-06-11T17:23:23.087 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP 2024-06-11T17:23:23.087 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosIoPP.XattrListPP 2024-06-11T17:23:23.087 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosIoPP.XattrListPP (3011 ms) 2024-06-11T17:23:23.087 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP (3011 ms total) 2024-06-11T17:23:23.087 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: 2024-06-11T17:23:23.087 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC 2024-06-11T17:23:23.087 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleWritePP 2024-06-11T17:23:23.087 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleWritePP (13980 ms) 2024-06-11T17:23:23.087 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.WaitForSafePP 2024-06-11T17:23:23.088 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAioEC.WaitForSafePP (6998 ms) 2024-06-11T17:23:23.088 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP 2024-06-11T17:23:23.088 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP (7046 ms) 2024-06-11T17:23:23.088 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP2 2024-06-11T17:23:23.088 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP2 (6964 ms) 2024-06-11T17:23:23.088 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP3 2024-06-11T17:23:23.088 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP3 (3014 ms) 2024-06-11T17:23:23.088 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2024-06-11T17:23:23.088 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripSparseReadPP (7021 ms) 2024-06-11T17:23:23.088 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripAppendPP 2024-06-11T17:23:23.088 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripAppendPP (6967 ms) 2024-06-11T17:23:23.088 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsCompletePP 2024-06-11T17:23:23.089 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsCompletePP (7075 ms) 2024-06-11T17:23:23.089 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsSafePP 2024-06-11T17:23:23.089 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsSafePP (6951 ms) 2024-06-11T17:23:23.089 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ReturnValuePP 2024-06-11T17:23:23.089 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ReturnValuePP (6981 ms) 2024-06-11T17:23:23.089 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushPP 2024-06-11T17:23:23.089 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushPP (7025 ms) 2024-06-11T17:23:23.089 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushAsyncPP 2024-06-11T17:23:23.089 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushAsyncPP (6992 ms) 2024-06-11T17:23:23.089 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2024-06-11T17:23:23.089 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP (7021 ms) 2024-06-11T17:23:23.090 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2024-06-11T17:23:58.030 INFO:tasks.workunit.client.0.smithi130.stdout:63:head 2024-06-11T17:23:58.031 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:5d165639:::164:head 2024-06-11T17:23:58.031 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:f43765fc:::165:head 2024-06-11T17:23:58.031 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:b4c720e9:::166:head 2024-06-11T17:23:58.031 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:e694b040:::167:head 2024-06-11T17:23:58.031 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:afa38db2:::168:head 2024-06-11T17:23:58.031 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:77ba9f53:::169:head 2024-06-11T17:23:58.031 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:87495034:::170:head 2024-06-11T17:23:58.031 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:7c96bf0e:::171:head 2024-06-11T17:23:58.031 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:dbe346cc:::172:head 2024-06-11T17:23:58.031 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:e943ec24:::173:head 2024-06-11T17:23:58.032 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:f97a9c0c:::174:head 2024-06-11T17:23:58.032 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:6f26e74d:::175:head 2024-06-11T17:23:58.032 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:4f95e106:::176:head 2024-06-11T17:23:58.032 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:0e6f2f8f:::177:head 2024-06-11T17:23:58.032 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:05db05f1:::178:head 2024-06-11T17:23:58.032 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:38a78d66:::179:head 2024-06-11T17:23:58.032 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:d095610b:::180:head 2024-06-11T17:23:58.032 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:a1a9d709:::181:head 2024-06-11T17:23:58.032 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:1e5d39db:::182:head 2024-06-11T17:23:58.032 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:f7df4fb9:::183:head 2024-06-11T17:23:58.032 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:03a7f161:::184:head 2024-06-11T17:23:58.032 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:ba70721e:::185:head 2024-06-11T17:23:58.032 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:28e5662d:::186:head 2024-06-11T17:23:58.032 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:973d52de:::187:head 2024-06-11T17:23:58.033 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:4303eb1c:::188:head 2024-06-11T17:23:58.033 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:b990b48e:::189:head 2024-06-11T17:23:58.033 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:29b8165b:::190:head 2024-06-11T17:23:58.033 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:3547f197:::191:head 2024-06-11T17:23:58.033 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:7e260936:::192:head 2024-06-11T17:23:58.033 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:1abec7b1:::193:head 2024-06-11T17:23:58.033 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:10fdda93:::194:head 2024-06-11T17:23:58.033 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:15817eea:::195:head 2024-06-11T17:23:58.033 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:770bab57:::196:head 2024-06-11T17:23:58.033 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:ed9e13e7:::197:head 2024-06-11T17:23:58.033 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:71471a8f:::198:head 2024-06-11T17:23:58.033 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: checking for 272:10fb1d02:::199:head 2024-06-11T17:23:58.033 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetWrite (8964 ms) 2024-06-11T17:23:58.033 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2024-06-11T17:23:58.034 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: got ls 1718126593,0 2024-06-11T17:23:58.034 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: first is 1718126593 2024-06-11T17:23:58.034 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: got ls 1718126593,0 2024-06-11T17:23:58.034 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: got ls 1718126593,0 2024-06-11T17:23:58.034 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: got ls 1718126593,1718126595,1718126596,0 2024-06-11T17:23:58.034 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: got ls 1718126593,1718126595,1718126596,0 2024-06-11T17:23:58.034 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: got ls 1718126593,1718126595,1718126596,0 2024-06-11T17:23:58.034 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: got ls 1718126593,1718126595,1718126596,1718126598,1718126599,0 2024-06-11T17:23:58.034 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: got ls 1718126593,1718126595,1718126596,1718126598,1718126599,0 2024-06-11T17:23:58.034 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: got ls 1718126593,1718126595,1718126596,1718126598,1718126599,0 2024-06-11T17:23:58.034 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: got ls 1718126593,1718126595,1718126596,1718126598,1718126599,1718126601,1718126602,0 2024-06-11T17:23:58.034 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: got ls 1718126593,1718126595,1718126596,1718126598,1718126599,1718126601,1718126602,0 2024-06-11T17:23:58.034 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: got ls 1718126593,1718126595,1718126596,1718126598,1718126599,1718126601,1718126602,0 2024-06-11T17:23:58.034 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: got ls 1718126596,1718126598,1718126599,1718126601,1718126602,1718126604,1718126605,0 2024-06-11T17:23:58.035 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: first now 1718126596, trimmed 2024-06-11T17:23:58.035 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetTrim (21057 ms) 2024-06-11T17:23:58.035 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-06-11T17:23:58.035 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: foo0 2024-06-11T17:23:58.035 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: verifying foo0 is eventually promoted 2024-06-11T17:23:58.035 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteOn2ndRead (13992 ms) 2024-06-11T17:23:58.035 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ProxyRead 2024-06-11T17:24:05.099 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP2 (3035 ms) 2024-06-11T17:24:05.099 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPP 2024-06-11T17:24:05.099 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPP (6943 ms) 2024-06-11T17:24:05.099 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPPNS 2024-06-11T17:24:05.099 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPPNS (6994 ms) 2024-06-11T17:24:05.099 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.StatRemovePP 2024-06-11T17:24:05.099 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAioEC.StatRemovePP (7067 ms) 2024-06-11T17:24:05.099 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ExecuteClassPP 2024-06-11T17:24:05.099 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ExecuteClassPP (6978 ms) 2024-06-11T17:24:05.099 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.OmapPP 2024-06-11T17:24:05.100 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAioEC.OmapPP (6969 ms) 2024-06-11T17:24:05.100 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.MultiWritePP 2024-06-11T17:24:05.100 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ OK ] LibRadosAioEC.MultiWritePP (7059 ms) 2024-06-11T17:24:05.100 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC (139082 ms total) 2024-06-11T17:24:05.100 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: 2024-06-11T17:24:05.100 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [----------] Global test environment tear-down 2024-06-11T17:24:05.100 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [==========] 57 tests from 4 test suites ran. (286511 ms total) 2024-06-11T17:24:05.100 INFO:tasks.workunit.client.0.smithi130.stdout: api_aio_pp: [ PASSED ] 57 tests. 2024-06-11T17:26:51.173 INFO:tasks.ceph.osd.5.smithi172.stderr:2024-06-11T17:26:51.176+0000 7f585a321640 -1 snap_mapper.add_oid found existing snaps mapped on 300:dad38e75:test-rados-api-smithi130-31677-80::foo:2, removing 2024-06-11T17:26:51.174 INFO:tasks.ceph.osd.0.smithi130.stderr:2024-06-11T17:26:51.175+0000 7fc9de6aa640 -1 snap_mapper.add_oid found existing snaps mapped on 300:dad38e75:test-rados-api-smithi130-31677-80::foo:2, removing 2024-06-11T17:27:22.243 INFO:tasks.workunit.client.0.smithi130.stdout: OK ] LibRadosTwoPoolsPP.ProxyRead (17956 ms) 2024-06-11T17:27:22.244 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.CachePin 2024-06-11T17:27:22.244 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.CachePin (22091 ms) 2024-06-11T17:27:22.244 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2024-06-11T17:27:22.244 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.SetRedirectRead (3012 ms) 2024-06-11T17:27:22.244 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-06-11T17:27:22.244 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: require_osd_release = squid 2024-06-11T17:27:22.244 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestPromoteRead (3001 ms) 2024-06-11T17:27:22.244 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2024-06-11T17:27:22.244 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRefRead (2915 ms) 2024-06-11T17:27:22.245 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2024-06-11T17:27:22.245 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: require_osd_release = squid 2024-06-11T17:27:22.245 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestUnset (3002 ms) 2024-06-11T17:27:22.245 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-06-11T17:27:22.245 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: require_osd_release = squid 2024-06-11T17:27:22.245 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestDedupRefRead (4039 ms) 2024-06-11T17:27:22.245 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-06-11T17:27:22.245 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: require_osd_release = squid 2024-06-11T17:27:22.245 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount (38093 ms) 2024-06-11T17:27:22.245 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-06-11T17:27:22.245 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: require_osd_release = squid 2024-06-11T17:27:22.245 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (16898 ms) 2024-06-11T17:27:22.245 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-06-11T17:27:22.245 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: require_osd_release = squid 2024-06-11T17:27:22.246 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (4031 ms) 2024-06-11T17:27:22.246 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-06-11T17:27:22.246 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: require_osd_release = squid 2024-06-11T17:27:22.246 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (2953 ms) 2024-06-11T17:27:22.246 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-06-11T17:27:22.246 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: require_osd_release = squid 2024-06-11T17:27:22.246 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (25036 ms) 2024-06-11T17:27:22.246 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-06-11T17:27:22.246 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: require_osd_release = squid 2024-06-11T17:27:22.246 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapIncCount (15061 ms) 2024-06-11T17:27:22.246 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2024-06-11T17:27:22.246 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: require_osd_release = squid 2024-06-11T17:27:22.246 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvict (5038 ms) 2024-06-11T17:27:22.246 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-06-11T17:27:22.247 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: require_osd_release = squid 2024-06-11T17:27:22.247 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictPromote (3888 ms) 2024-06-11T17:27:22.247 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-06-11T17:27:22.247 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: require_osd_release = squid 2024-06-11T17:27:22.247 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: waiting for scrubs... 2024-06-11T17:27:22.247 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: done waiting 2024-06-11T17:27:22.247 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (25062 ms) 2024-06-11T17:27:22.247 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2024-06-11T17:27:22.247 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: require_osd_release = squid 2024-06-11T17:27:22.247 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.DedupFlushRead (9987 ms) 2024-06-11T17:27:22.248 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-06-11T17:27:22.248 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: require_osd_release = squid 2024-06-11T17:27:22.248 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushSnap (9003 ms) 2024-06-11T17:27:22.248 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-06-11T17:27:22.248 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: require_osd_release = squid 2024-06-11T17:27:22.248 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushDupCount (9052 ms) 2024-06-11T17:27:22.248 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-06-11T17:28:19.199 INFO:tasks.ceph.osd.3.smithi130.stderr:2024-06-11T17:28:19.202+0000 7fd55d1a8640 -1 snap_mapper.add_oid found existing snaps mapped on 102:624bbb1a:test-rados-api-smithi130-31677-97::foo:22, removing 2024-06-11T17:28:19.200 INFO:tasks.ceph.osd.6.smithi172.stderr:2024-06-11T17:28:19.204+0000 7f692990e640 -1 snap_mapper.add_oid found existing snaps mapped on 102:624bbb1a:test-rados-api-smithi130-31677-97::foo:22, removing 2024-06-11T17:30:54.244 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: require_osd_release = squid 2024-06-11T17:30:54.245 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringFlush (8911 ms) 2024-06-11T17:30:54.245 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-06-11T17:30:54.245 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: require_osd_release = squid 2024-06-11T17:30:54.245 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (6058 ms) 2024-06-11T17:30:54.245 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2024-06-11T17:30:54.245 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: require_osd_release = squid 2024-06-11T17:30:54.246 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollback (5038 ms) 2024-06-11T17:30:54.246 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-06-11T17:30:54.246 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: require_osd_release = squid 2024-06-11T17:30:54.246 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (25937 ms) 2024-06-11T17:30:54.246 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-06-11T17:30:54.246 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: require_osd_release = squid 2024-06-11T17:30:54.246 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictRollback (14092 ms) 2024-06-11T17:30:54.246 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-06-11T17:30:54.246 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PropagateBaseTierError (11937 ms) 2024-06-11T17:30:54.246 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-06-11T17:30:54.246 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: 00000000 79 6f 75 20 6d 69 67 68 74 20 73 65 65 20 74 68 |you might see th| 2024-06-11T17:30:54.246 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: 00000010 69 73 |is| 2024-06-11T17:30:54.247 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: 00000012 2024-06-11T17:30:54.247 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HelloWriteReturn (12021 ms) 2024-06-11T17:30:54.247 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-06-11T17:30:54.247 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: require_osd_release = squid 2024-06-11T17:30:54.247 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (5972 ms) 2024-06-11T17:30:54.247 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP (556266 ms total) 2024-06-11T17:30:54.247 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: 2024-06-11T17:30:54.247 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP 2024-06-11T17:30:54.247 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.Dirty 2024-06-11T17:30:54.247 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.Dirty (1031 ms) 2024-06-11T17:30:54.247 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.FlushWriteRaces 2024-06-11T17:30:54.247 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.FlushWriteRaces (10957 ms) 2024-06-11T17:30:54.247 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.CallForcesPromote 2024-06-11T17:30:54.248 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.CallForcesPromote (18053 ms) 2024-06-11T17:30:54.248 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.HitSetNone 2024-06-11T17:30:54.248 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.HitSetNone (7 ms) 2024-06-11T17:30:54.248 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP (30048 ms total) 2024-06-11T17:30:54.248 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: 2024-06-11T17:30:54.248 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP 2024-06-11T17:30:54.248 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Overlay 2024-06-11T17:30:54.248 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Overlay (6989 ms) 2024-06-11T17:30:54.248 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Promote 2024-06-11T17:30:54.248 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Promote (8077 ms) 2024-06-11T17:30:54.248 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2024-06-11T17:30:54.248 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: waiting for scrub... 2024-06-11T17:30:54.248 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: done waiting 2024-06-11T17:30:54.249 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnap (25034 ms) 2024-06-11T17:30:54.249 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-06-11T17:30:54.249 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (9976 ms) 2024-06-11T17:30:54.249 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Whiteout 2024-06-11T17:30:54.249 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Whiteout (8016 ms) 2024-06-11T17:30:54.249 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Evict 2024-06-11T17:30:54.249 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Evict (8067 ms) 2024-06-11T17:30:54.249 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2024-06-11T17:30:54.249 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.EvictSnap (9892 ms) 2024-06-11T17:30:54.249 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlush 2024-06-11T17:33:25.326 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlush (8015 ms) 2024-06-11T17:33:25.326 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2024-06-11T17:33:25.327 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FailedFlush (13098 ms) 2024-06-11T17:33:25.327 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Flush 2024-06-11T17:33:25.327 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Flush (8087 ms) 2024-06-11T17:33:25.327 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2024-06-11T17:33:25.327 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushSnap (12852 ms) 2024-06-11T17:33:25.327 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-06-11T17:33:25.327 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (7950 ms) 2024-06-11T17:33:25.327 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-06-11T17:33:25.327 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlushReadRace (8069 ms) 2024-06-11T17:33:25.327 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2024-06-11T17:33:25.327 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: hmm, no HitSet yet 2024-06-11T17:33:25.328 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: ok, hit_set contains 332:602f83fe:::foo:head 2024-06-11T17:33:25.328 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetRead (9071 ms) 2024-06-11T17:33:25.328 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2024-06-11T17:33:25.328 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: got ls 1718127121,0 2024-06-11T17:33:25.328 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: first is 1718127121 2024-06-11T17:33:25.328 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: got ls 1718127121,0 2024-06-11T17:33:25.328 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: got ls 1718127121,0 2024-06-11T17:33:25.328 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: got ls 1718127121,1718127123,1718127124,0 2024-06-11T17:33:25.328 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: got ls 1718127121,1718127123,1718127124,0 2024-06-11T17:33:25.329 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: got ls 1718127121,1718127123,1718127124,0 2024-06-11T17:33:25.329 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: got ls 1718127121,1718127123,1718127124,1718127126,1718127127,0 2024-06-11T17:33:25.329 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: got ls 1718127121,1718127123,1718127124,1718127126,1718127127,0 2024-06-11T17:33:25.329 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: got ls 1718127121,1718127123,1718127124,1718127126,1718127127,0 2024-06-11T17:33:25.329 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: got ls 1718127121,1718127123,1718127124,1718127126,1718127127,1718127129,1718127130,0 2024-06-11T17:33:25.329 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: got ls 1718127121,1718127123,1718127124,1718127126,1718127127,1718127129,1718127130,0 2024-06-11T17:33:25.329 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: got ls 1718127121,1718127123,1718127124,1718127126,1718127127,1718127129,1718127130,0 2024-06-11T17:33:25.329 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: got ls 1718127124,1718127126,1718127127,1718127129,1718127130,1718127132,1718127133,0 2024-06-11T17:33:25.329 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: first now 1718127124, trimmed 2024-06-11T17:33:25.330 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetTrim (20934 ms) 2024-06-11T17:33:25.330 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-06-11T17:33:25.330 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: foo0 2024-06-11T17:33:25.330 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: verifying foo0 is eventually promoted 2024-06-11T17:33:25.330 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (13979 ms) 2024-06-11T17:33:25.330 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2024-06-11T17:33:25.330 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ProxyRead (18000 ms) 2024-06-11T17:33:25.330 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.CachePin 2024-06-11T17:33:25.330 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.CachePin (21973 ms) 2024-06-11T17:33:25.330 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-06-11T17:33:25.331 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetRedirectRead (5071 ms) 2024-06-11T17:33:25.331 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2024-06-11T17:33:25.331 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetChunkRead (3016 ms) 2024-06-11T17:33:25.331 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-06-11T17:33:25.331 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ManifestPromoteRead (2927 ms) 2024-06-11T17:33:25.331 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-06-11T17:33:25.331 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TrySetDedupTier (3016 ms) 2024-06-11T17:33:25.331 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP (232111 ms total) 2024-06-11T17:33:25.331 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: 2024-06-11T17:33:25.331 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [----------] Global test environment tear-down 2024-06-11T17:33:25.332 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [==========] 77 tests from 4 test suites ran. (846627 ms total) 2024-06-11T17:33:25.332 INFO:tasks.workunit.client.0.smithi130.stdout: api_tier_pp: [ PASSED ] 77 tests. 2024-06-11T17:33:25.333 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.333 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31535 2024-06-11T17:33:25.333 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 31535 2024-06-11T17:33:25.334 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.334 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31721 2024-06-11T17:33:25.334 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 31721 2024-06-11T17:33:25.334 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.334 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=32047 2024-06-11T17:33:25.334 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 32047 2024-06-11T17:33:25.334 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.335 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31934 2024-06-11T17:33:25.335 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 31934 2024-06-11T17:33:25.335 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.335 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31775 2024-06-11T17:33:25.335 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 31775 2024-06-11T17:33:25.335 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.335 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31584 2024-06-11T17:33:25.336 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 31584 2024-06-11T17:33:25.336 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.336 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31861 2024-06-11T17:33:25.336 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 31861 2024-06-11T17:33:25.336 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.336 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=32318 2024-06-11T17:33:25.336 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 32318 2024-06-11T17:33:25.336 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.336 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=32345 2024-06-11T17:33:25.336 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 32345 2024-06-11T17:33:25.337 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.337 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31642 2024-06-11T17:33:25.337 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 31642 2024-06-11T17:33:25.337 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.337 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=32097 2024-06-11T17:33:25.337 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 32097 2024-06-11T17:33:25.337 INFO:tasks.workunit.client.0.smithi130.stdout:error in cls (32097) 2024-06-11T17:33:25.338 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'error in cls (32097)' 2024-06-11T17:33:25.338 INFO:tasks.workunit.client.0.smithi130.stderr:+ ret=1 2024-06-11T17:33:25.338 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.338 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31519 2024-06-11T17:33:25.338 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 31519 2024-06-11T17:33:25.338 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.338 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31551 2024-06-11T17:33:25.338 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 31551 2024-06-11T17:33:25.338 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.338 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=32012 2024-06-11T17:33:25.339 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 32012 2024-06-11T17:33:25.339 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.339 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31511 2024-06-11T17:33:25.339 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 31511 2024-06-11T17:33:25.339 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.339 INFO:tasks.workunit.client.0.smithi130.stdout:error in api_io_pp (31527) 2024-06-11T17:33:25.342 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31527 2024-06-11T17:33:25.342 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 31527 2024-06-11T17:33:25.342 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'error in api_io_pp (31527)' 2024-06-11T17:33:25.342 INFO:tasks.workunit.client.0.smithi130.stderr:+ ret=1 2024-06-11T17:33:25.342 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.342 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=32389 2024-06-11T17:33:25.343 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 32389 2024-06-11T17:33:25.343 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.343 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31733 2024-06-11T17:33:25.343 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 31733 2024-06-11T17:33:25.343 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.343 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=32449 2024-06-11T17:33:25.343 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 32449 2024-06-11T17:33:25.343 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.343 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31782 2024-06-11T17:33:25.343 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 31782 2024-06-11T17:33:25.343 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.343 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=32230 2024-06-11T17:33:25.343 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 32230 2024-06-11T17:33:25.344 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.344 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=32513 2024-06-11T17:33:25.344 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 32513 2024-06-11T17:33:25.344 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.344 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31766 2024-06-11T17:33:25.344 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 31766 2024-06-11T17:33:25.344 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.344 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=32030 2024-06-11T17:33:25.344 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 32030 2024-06-11T17:33:25.344 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.344 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=32380 2024-06-11T17:33:25.345 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 32380 2024-06-11T17:33:25.345 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.345 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=32133 2024-06-11T17:33:25.345 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 32133 2024-06-11T17:33:25.345 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.345 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=32412 2024-06-11T17:33:25.345 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 32412 2024-06-11T17:33:25.345 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.345 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=32004 2024-06-11T17:33:25.345 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 32004 2024-06-11T17:33:25.345 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.345 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31680 2024-06-11T17:33:25.345 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 31680 2024-06-11T17:33:25.345 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.345 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=32490 2024-06-11T17:33:25.346 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 32490 2024-06-11T17:33:25.346 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.346 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31954 2024-06-11T17:33:25.346 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 31954 2024-06-11T17:33:25.346 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.346 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31503 2024-06-11T17:33:25.346 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 31503 2024-06-11T17:33:25.346 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.346 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31543 2024-06-11T17:33:25.346 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 31543 2024-06-11T17:33:25.346 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.346 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31919 2024-06-11T17:33:25.346 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 31919 2024-06-11T17:33:25.346 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.347 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31558 2024-06-11T17:33:25.347 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 31558 2024-06-11T17:33:25.347 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.347 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31964 2024-06-11T17:33:25.347 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 31964 2024-06-11T17:33:25.347 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.347 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=31994 2024-06-11T17:33:25.347 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 31994 2024-06-11T17:33:25.347 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.347 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=32365 2024-06-11T17:33:25.347 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 32365 2024-06-11T17:33:25.347 INFO:tasks.workunit.client.0.smithi130.stderr:+ for t in "${!pids[@]}" 2024-06-11T17:33:25.348 INFO:tasks.workunit.client.0.smithi130.stderr:+ pid=32533 2024-06-11T17:33:25.348 INFO:tasks.workunit.client.0.smithi130.stderr:+ wait 32533 2024-06-11T17:33:25.348 INFO:tasks.workunit.client.0.smithi130.stderr:+ exit 1 2024-06-11T17:33:25.348 INFO:tasks.workunit.client.0.smithi130.stderr:+ cleanup 2024-06-11T17:33:25.348 INFO:tasks.workunit.client.0.smithi130.stderr:+ pkill -P 31497 2024-06-11T17:33:25.431 INFO:tasks.workunit.client.0.smithi130.stderr:+ true 2024-06-11T17:33:25.432 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-11T17:33:25.432 INFO:tasks.workunit:Stopping ['rados/test.sh', 'rados/test_pool_quota.sh'] on client.0... 2024-06-11T17:33:25.433 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-06-11T17:33:25.729 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_37bbe1d8d788b7c9a71280e7d510c295a5853f0b/qa/tasks/workunit.py", line 126, in task with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_37bbe1d8d788b7c9a71280e7d510c295a5853f0b/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rados/test.sh) on smithi130 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=37bbe1d8d788b7c9a71280e7d510c295a5853f0b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2024-06-11T17:33:25.912 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=733199fabb7b419f86434189f0fa3866 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_37bbe1d8d788b7c9a71280e7d510c295a5853f0b/qa/tasks/workunit.py", line 126, in task with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_37bbe1d8d788b7c9a71280e7d510c295a5853f0b/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rados/test.sh) on smithi130 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=37bbe1d8d788b7c9a71280e7d510c295a5853f0b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2024-06-11T17:33:25.914 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-06-11T17:33:25.924 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-11T17:33:25.924 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-11T17:33:26.059 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.057+0000 7f7230c29640 1 Processor -- start 2024-06-11T17:33:26.059 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.057+0000 7f7230c29640 1 -- start start 2024-06-11T17:33:26.059 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.061+0000 7f7230c29640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f722c0b03f0 0x7f722c142ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:26.059 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.061+0000 7f7230c29640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f722c1404e0 0x7f722c1430e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:26.060 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.061+0000 7f7230c29640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f722c06fde0 con 0x7f722c06c2b0 2024-06-11T17:33:26.060 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.061+0000 7f7230c29640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f722c06c690 con 0x7f722c1404e0 2024-06-11T17:33:26.060 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.061+0000 7f7230c29640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f722c143620 con 0x7f722c0b03f0 2024-06-11T17:33:26.060 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.061+0000 7f722ad9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f722c1404e0 0x7f722c1430e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:26.060 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.061+0000 7f722a59c640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f722c06c2b0 0x7f722c13fdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:40926/0 (socket says 172.21.15.130:40926) 2024-06-11T17:33:26.060 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.061+0000 7f722a59c640 1 -- 172.21.15.130:0/1996152024 learned_addr learned my addr 172.21.15.130:0/1996152024 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-06-11T17:33:26.060 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.061+0000 7f7229d9b640 1 --2- 172.21.15.130:0/1996152024 >> v2:172.21.15.172:3300/0 conn(0x7f722c0b03f0 0x7f722c142ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:26.060 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.061+0000 7f722ad9d640 1 -- 172.21.15.130:0/1996152024 >> v2:172.21.15.172:3300/0 conn(0x7f722c0b03f0 msgr2=0x7f722c142ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:33:26.061 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.061+0000 7f722ad9d640 1 --2- 172.21.15.130:0/1996152024 >> v2:172.21.15.172:3300/0 conn(0x7f722c0b03f0 0x7f722c142ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:26.061 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.061+0000 7f722ad9d640 1 -- 172.21.15.130:0/1996152024 >> v1:172.21.15.130:6789/0 conn(0x7f722c06c2b0 legacy=0x7f722c13fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:26.061 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.061+0000 7f722959a640 1 -- 172.21.15.130:0/1996152024 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2321838563 0 0) 0x7f722c06fde0 con 0x7f722c06c2b0 2024-06-11T17:33:26.061 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.061+0000 7f722ad9d640 1 -- 172.21.15.130:0/1996152024 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f722c0b0910 con 0x7f722c1404e0 2024-06-11T17:33:26.063 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f722ad9d640 1 --2- 172.21.15.130:0/1996152024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f722c1404e0 0x7f722c1430e0 secure :-1 s=READY pgs=4036 cs=0 l=1 rev1=1 crypto rx=0x7f722c063500 tx=0x7f722401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb84628372b198a4 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:26.063 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f722959a640 1 -- 172.21.15.130:0/1996152024 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72240b2070 con 0x7f722c1404e0 2024-06-11T17:33:26.063 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f722959a640 1 -- 172.21.15.130:0/1996152024 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72240a5850 con 0x7f722c1404e0 2024-06-11T17:33:26.063 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f722959a640 1 -- 172.21.15.130:0/1996152024 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722c06cfa0 con 0x7f722c1404e0 2024-06-11T17:33:26.064 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f7230c29640 1 -- 172.21.15.130:0/1996152024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f722c1404e0 msgr2=0x7f722c1430e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:26.064 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f7230c29640 1 --2- 172.21.15.130:0/1996152024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f722c1404e0 0x7f722c1430e0 secure :-1 s=READY pgs=4036 cs=0 l=1 rev1=1 crypto rx=0x7f722c063500 tx=0x7f722401c880 comp rx=0 tx=0).stop 2024-06-11T17:33:26.064 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f7230c29640 1 -- 172.21.15.130:0/1996152024 shutdown_connections 2024-06-11T17:33:26.065 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f7230c29640 1 --2- 172.21.15.130:0/1996152024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f722c1404e0 0x7f722c1430e0 unknown :-1 s=CLOSED pgs=4036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:26.065 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f7230c29640 1 --2- 172.21.15.130:0/1996152024 >> v2:172.21.15.172:3300/0 conn(0x7f722c0b03f0 0x7f722c142ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:26.065 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f7230c29640 1 -- 172.21.15.130:0/1996152024 >> 172.21.15.130:0/1996152024 conn(0x7f722c06db80 msgr2=0x7f722c0b56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:26.065 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f7230c29640 1 -- 172.21.15.130:0/1996152024 shutdown_connections 2024-06-11T17:33:26.065 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f7230c29640 1 -- 172.21.15.130:0/1996152024 wait complete. 2024-06-11T17:33:26.065 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f7230c29640 1 Processor -- start 2024-06-11T17:33:26.065 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f7230c29640 1 -- start start 2024-06-11T17:33:26.067 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f7230c29640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f722c06c2b0 0x7f722c071f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:26.067 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f7230c29640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f722c0b03f0 0x7f722c144240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:26.067 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f7230c29640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f722c1404e0 0x7f722c144780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:26.068 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f7230c29640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f722c14ff80 con 0x7f722c06c2b0 2024-06-11T17:33:26.068 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f7230c29640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f722c14fe00 con 0x7f722c1404e0 2024-06-11T17:33:26.068 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f7230c29640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f722c150100 con 0x7f722c0b03f0 2024-06-11T17:33:26.068 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f722a59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f722c06c2b0 0x7f722c071f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:26.068 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f722a59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f722c06c2b0 0x7f722c071f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44086/0 (socket says 172.21.15.130:44086) 2024-06-11T17:33:26.068 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f722a59c640 1 -- 172.21.15.130:0/4247661957 learned_addr learned my addr 172.21.15.130:0/4247661957 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:33:26.068 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f7229d9b640 1 --2- 172.21.15.130:0/4247661957 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f722c0b03f0 0x7f722c144240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:26.068 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f722a59c640 1 -- 172.21.15.130:0/4247661957 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f722c0b03f0 msgr2=0x7f722c144240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:26.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f722a59c640 1 --2- 172.21.15.130:0/4247661957 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f722c0b03f0 0x7f722c144240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:26.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f722a59c640 1 -- 172.21.15.130:0/4247661957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f722c1404e0 msgr2=0x7f722c144780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:26.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f722a59c640 1 --2- 172.21.15.130:0/4247661957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f722c1404e0 0x7f722c144780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:26.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f722a59c640 1 -- 172.21.15.130:0/4247661957 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f722c147960 con 0x7f722c06c2b0 2024-06-11T17:33:26.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f722a59c640 1 --2- 172.21.15.130:0/4247661957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f722c06c2b0 0x7f722c071f80 secure :-1 s=READY pgs=4037 cs=0 l=1 rev1=1 crypto rx=0x7f722000c4c0 tx=0x7f722000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:26.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f721affd640 1 -- 172.21.15.130:0/4247661957 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7220018070 con 0x7f722c06c2b0 2024-06-11T17:33:26.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f721affd640 1 -- 172.21.15.130:0/4247661957 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7220007500 con 0x7f722c06c2b0 2024-06-11T17:33:26.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f7230c29640 1 -- 172.21.15.130:0/4247661957 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f722c1480d0 con 0x7f722c06c2b0 2024-06-11T17:33:26.070 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f721affd640 1 -- 172.21.15.130:0/4247661957 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7220004a30 con 0x7f722c06c2b0 2024-06-11T17:33:26.070 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.065+0000 7f7230c29640 1 -- 172.21.15.130:0/4247661957 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f722c147360 con 0x7f722c06c2b0 2024-06-11T17:33:26.070 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.069+0000 7f7230c29640 1 -- 172.21.15.130:0/4247661957 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f722c13fdd0 con 0x7f722c06c2b0 2024-06-11T17:33:26.070 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.069+0000 7f721affd640 1 -- 172.21.15.130:0/4247661957 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f722001b070 con 0x7f722c06c2b0 2024-06-11T17:33:26.071 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.069+0000 7f721affd640 1 --2- 172.21.15.130:0/4247661957 >> v2:172.21.15.130:6816/3863300924 conn(0x7f720c070d90 0x7f720c073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:26.071 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.069+0000 7f721affd640 1 -- 172.21.15.130:0/4247661957 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(702..702 src has 82..702) ==== 5253+0+0 (secure 0 0 0) 0x7f72200902a0 con 0x7f722c06c2b0 2024-06-11T17:33:26.071 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.069+0000 7f7229d9b640 1 --2- 172.21.15.130:0/4247661957 >> v2:172.21.15.130:6816/3863300924 conn(0x7f720c070d90 0x7f720c073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:26.071 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.069+0000 7f7229d9b640 1 --2- 172.21.15.130:0/4247661957 >> v2:172.21.15.130:6816/3863300924 conn(0x7f720c070d90 0x7f720c073250 secure :-1 s=READY pgs=3435 cs=0 l=1 rev1=1 crypto rx=0x7f722c0724c0 tx=0x7f721c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:26.072 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.073+0000 7f721affd640 1 -- 172.21.15.130:0/4247661957 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7f722c147960 con 0x7f722c06c2b0 2024-06-11T17:33:26.234 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.237+0000 7f7230c29640 1 -- 172.21.15.130:0/4247661957 --> v2:172.21.15.130:6816/3863300924 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f722c143ea0 con 0x7f720c070d90 2024-06-11T17:33:26.240 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.241+0000 7f721affd640 1 -- 172.21.15.130:0/4247661957 <== mgr.4107 v2:172.21.15.130:6816/3863300924 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+116183 (secure 0 0 0) 0x7f722c143ea0 con 0x7f720c070d90 2024-06-11T17:33:26.241 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:33:26.242 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2024-06-11T17:33:26.243 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.245+0000 7f7230c29640 1 -- 172.21.15.130:0/4247661957 >> v2:172.21.15.130:6816/3863300924 conn(0x7f720c070d90 msgr2=0x7f720c073250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:26.243 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.245+0000 7f7230c29640 1 --2- 172.21.15.130:0/4247661957 >> v2:172.21.15.130:6816/3863300924 conn(0x7f720c070d90 0x7f720c073250 secure :-1 s=READY pgs=3435 cs=0 l=1 rev1=1 crypto rx=0x7f722c0724c0 tx=0x7f721c008040 comp rx=0 tx=0).stop 2024-06-11T17:33:26.243 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.245+0000 7f7230c29640 1 -- 172.21.15.130:0/4247661957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f722c06c2b0 msgr2=0x7f722c071f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:26.244 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.245+0000 7f7230c29640 1 --2- 172.21.15.130:0/4247661957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f722c06c2b0 0x7f722c071f80 secure :-1 s=READY pgs=4037 cs=0 l=1 rev1=1 crypto rx=0x7f722000c4c0 tx=0x7f722000c980 comp rx=0 tx=0).stop 2024-06-11T17:33:26.244 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.245+0000 7f7230c29640 1 -- 172.21.15.130:0/4247661957 shutdown_connections 2024-06-11T17:33:26.244 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.245+0000 7f7230c29640 1 --2- 172.21.15.130:0/4247661957 >> v2:172.21.15.130:6816/3863300924 conn(0x7f720c070d90 0x7f720c073250 unknown :-1 s=CLOSED pgs=3435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:26.244 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.245+0000 7f7230c29640 1 --2- 172.21.15.130:0/4247661957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f722c1404e0 0x7f722c144780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:26.244 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.245+0000 7f7230c29640 1 --2- 172.21.15.130:0/4247661957 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f722c0b03f0 0x7f722c144240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:26.244 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.245+0000 7f7230c29640 1 --2- 172.21.15.130:0/4247661957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f722c06c2b0 0x7f722c071f80 unknown :-1 s=CLOSED pgs=4037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:26.244 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.245+0000 7f7230c29640 1 -- 172.21.15.130:0/4247661957 >> 172.21.15.130:0/4247661957 conn(0x7f722c06db80 msgr2=0x7f722c13cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:26.244 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.245+0000 7f7230c29640 1 -- 172.21.15.130:0/4247661957 shutdown_connections 2024-06-11T17:33:26.244 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.245+0000 7f7230c29640 1 -- 172.21.15.130:0/4247661957 wait complete. 2024-06-11T17:33:26.260 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":1149,"stamp":"2024-06-11T17:33:25.309401+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590373,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":61,"num_write":108,"num_write_kb":1635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":139,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":604648,"kb_used_data":71936,"kb_used_omap":12,"kb_used_meta":532531,"kb_avail":754370072,"statfs":{"total":773094113280,"available":772474953728,"internally_reserved":0,"allocated":73662464,"data_stored":38371450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":545312306},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4000299,"num_objects":-44,"num_object_clones":-1,"num_object_copies":-132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-44,"num_whiteouts":0,"num_read":-31,"num_read_kb":-11,"num_write":-71,"num_write_kb":-3969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":-1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.038794"},"pg_stats":[{"pgid":"8.18","version":"0'0","reported_seq":1352,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.298489+0000","last_change":"2024-06-11T17:19:20.252042+0000","last_active":"2024-06-11T17:33:23.298489+0000","last_peered":"2024-06-11T17:33:23.298489+0000","last_clean":"2024-06-11T17:33:23.298489+0000","last_became_active":"2024-06-11T17:19:20.245039+0000","last_became_peered":"2024-06-11T17:19:20.245039+0000","last_unstale":"2024-06-11T17:33:23.298489+0000","last_undegraded":"2024-06-11T17:33:23.298489+0000","last_fullsized":"2024-06-11T17:33:23.298489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:37.254125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1350,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.763955+0000","last_change":"2024-06-11T17:19:20.146092+0000","last_active":"2024-06-11T17:33:23.763955+0000","last_peered":"2024-06-11T17:33:23.763955+0000","last_clean":"2024-06-11T17:33:23.763955+0000","last_became_active":"2024-06-11T17:19:20.143262+0000","last_became_peered":"2024-06-11T17:19:20.143262+0000","last_unstale":"2024-06-11T17:33:23.763955+0000","last_undegraded":"2024-06-11T17:33:23.763955+0000","last_fullsized":"2024-06-11T17:33:23.763955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:24:15.418401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1348,"reported_epoch":701,"state":"active+clean","last_fresh":"2024-06-11T17:33:24.294973+0000","last_change":"2024-06-11T17:19:20.166997+0000","last_active":"2024-06-11T17:33:24.294973+0000","last_peered":"2024-06-11T17:33:24.294973+0000","last_clean":"2024-06-11T17:33:24.294973+0000","last_became_active":"2024-06-11T17:19:20.165147+0000","last_became_peered":"2024-06-11T17:19:20.165147+0000","last_unstale":"2024-06-11T17:33:24.294973+0000","last_undegraded":"2024-06-11T17:33:24.294973+0000","last_fullsized":"2024-06-11T17:33:24.294973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:08:34.862959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1352,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.299522+0000","last_change":"2024-06-11T17:19:20.204932+0000","last_active":"2024-06-11T17:33:23.299522+0000","last_peered":"2024-06-11T17:33:23.299522+0000","last_clean":"2024-06-11T17:33:23.299522+0000","last_became_active":"2024-06-11T17:19:20.204104+0000","last_became_peered":"2024-06-11T17:19:20.204104+0000","last_unstale":"2024-06-11T17:33:23.299522+0000","last_undegraded":"2024-06-11T17:33:23.299522+0000","last_fullsized":"2024-06-11T17:33:23.299522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:22:09.289002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1350,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.764217+0000","last_change":"2024-06-11T17:19:20.142647+0000","last_active":"2024-06-11T17:33:23.764217+0000","last_peered":"2024-06-11T17:33:23.764217+0000","last_clean":"2024-06-11T17:33:23.764217+0000","last_became_active":"2024-06-11T17:19:20.141398+0000","last_became_peered":"2024-06-11T17:19:20.141398+0000","last_unstale":"2024-06-11T17:33:23.764217+0000","last_undegraded":"2024-06-11T17:33:23.764217+0000","last_fullsized":"2024-06-11T17:33:23.764217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:37:49.933084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1343,"reported_epoch":699,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.115250+0000","last_change":"2024-06-11T17:19:20.195776+0000","last_active":"2024-06-11T17:33:23.115250+0000","last_peered":"2024-06-11T17:33:23.115250+0000","last_clean":"2024-06-11T17:33:23.115250+0000","last_became_active":"2024-06-11T17:19:20.192892+0000","last_became_peered":"2024-06-11T17:19:20.192892+0000","last_unstale":"2024-06-11T17:33:23.115250+0000","last_undegraded":"2024-06-11T17:33:23.115250+0000","last_fullsized":"2024-06-11T17:33:23.115250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T05:17:41.998549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1349,"reported_epoch":701,"state":"active+clean","last_fresh":"2024-06-11T17:33:24.295279+0000","last_change":"2024-06-11T17:19:20.175472+0000","last_active":"2024-06-11T17:33:24.295279+0000","last_peered":"2024-06-11T17:33:24.295279+0000","last_clean":"2024-06-11T17:33:24.295279+0000","last_became_active":"2024-06-11T17:19:20.175221+0000","last_became_peered":"2024-06-11T17:19:20.175221+0000","last_unstale":"2024-06-11T17:33:24.295279+0000","last_undegraded":"2024-06-11T17:33:24.295279+0000","last_fullsized":"2024-06-11T17:33:24.295279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T05:05:22.352892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1343,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.295333+0000","last_change":"2024-06-11T17:19:20.121498+0000","last_active":"2024-06-11T17:33:23.295333+0000","last_peered":"2024-06-11T17:33:23.295333+0000","last_clean":"2024-06-11T17:33:23.295333+0000","last_became_active":"2024-06-11T17:19:20.120302+0000","last_became_peered":"2024-06-11T17:19:20.120302+0000","last_unstale":"2024-06-11T17:33:23.295333+0000","last_undegraded":"2024-06-11T17:33:23.295333+0000","last_fullsized":"2024-06-11T17:33:23.295333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T05:14:47.533955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1374,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.296134+0000","last_change":"2024-06-11T17:19:20.243500+0000","last_active":"2024-06-11T17:33:23.296134+0000","last_peered":"2024-06-11T17:33:23.296134+0000","last_clean":"2024-06-11T17:33:23.296134+0000","last_became_active":"2024-06-11T17:19:20.243122+0000","last_became_peered":"2024-06-11T17:19:20.243122+0000","last_unstale":"2024-06-11T17:33:23.296134+0000","last_undegraded":"2024-06-11T17:33:23.296134+0000","last_fullsized":"2024-06-11T17:33:23.296134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:11:13.381933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1","version":"19'7","reported_seq":1356,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.294858+0000","last_change":"2024-06-11T17:19:20.192244+0000","last_active":"2024-06-11T17:33:23.294858+0000","last_peered":"2024-06-11T17:33:23.294858+0000","last_clean":"2024-06-11T17:33:23.294858+0000","last_became_active":"2024-06-11T17:19:20.191981+0000","last_became_peered":"2024-06-11T17:19:20.191981+0000","last_unstale":"2024-06-11T17:33:23.294858+0000","last_undegraded":"2024-06-11T17:33:23.294858+0000","last_fullsized":"2024-06-11T17:33:23.294858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:25:30.923332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1353,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.298585+0000","last_change":"2024-06-11T17:19:20.255611+0000","last_active":"2024-06-11T17:33:23.298585+0000","last_peered":"2024-06-11T17:33:23.298585+0000","last_clean":"2024-06-11T17:33:23.298585+0000","last_became_active":"2024-06-11T17:19:20.247875+0000","last_became_peered":"2024-06-11T17:19:20.247875+0000","last_unstale":"2024-06-11T17:33:23.298585+0000","last_undegraded":"2024-06-11T17:33:23.298585+0000","last_fullsized":"2024-06-11T17:33:23.298585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:31:10.443876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1343,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.294949+0000","last_change":"2024-06-11T17:19:20.250335+0000","last_active":"2024-06-11T17:33:23.294949+0000","last_peered":"2024-06-11T17:33:23.294949+0000","last_clean":"2024-06-11T17:33:23.294949+0000","last_became_active":"2024-06-11T17:19:20.250080+0000","last_became_peered":"2024-06-11T17:19:20.250080+0000","last_unstale":"2024-06-11T17:33:23.294949+0000","last_undegraded":"2024-06-11T17:33:23.294949+0000","last_fullsized":"2024-06-11T17:33:23.294949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:14:17.864074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":1435,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.526422+0000","last_change":"2024-06-11T17:18:20.659416+0000","last_active":"2024-06-11T17:33:23.526422+0000","last_peered":"2024-06-11T17:33:23.526422+0000","last_clean":"2024-06-11T17:33:23.526422+0000","last_became_active":"2024-06-11T17:18:20.657407+0000","last_became_peered":"2024-06-11T17:18:20.657407+0000","last_unstale":"2024-06-11T17:33:23.526422+0000","last_undegraded":"2024-06-11T17:33:23.526422+0000","last_fullsized":"2024-06-11T17:33:23.526422+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:15:37.551739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1358,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.764255+0000","last_change":"2024-06-11T17:18:20.575928+0000","last_active":"2024-06-11T17:33:23.764255+0000","last_peered":"2024-06-11T17:33:23.764255+0000","last_clean":"2024-06-11T17:33:23.764255+0000","last_became_active":"2024-06-11T17:18:20.575356+0000","last_became_peered":"2024-06-11T17:18:20.575356+0000","last_unstale":"2024-06-11T17:33:23.764255+0000","last_undegraded":"2024-06-11T17:33:23.764255+0000","last_fullsized":"2024-06-11T17:33:23.764255+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:57:32.714496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1343,"reported_epoch":699,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.113179+0000","last_change":"2024-06-11T17:19:20.247282+0000","last_active":"2024-06-11T17:33:23.113179+0000","last_peered":"2024-06-11T17:33:23.113179+0000","last_clean":"2024-06-11T17:33:23.113179+0000","last_became_active":"2024-06-11T17:19:20.238515+0000","last_became_peered":"2024-06-11T17:19:20.238515+0000","last_unstale":"2024-06-11T17:33:23.113179+0000","last_undegraded":"2024-06-11T17:33:23.113179+0000","last_fullsized":"2024-06-11T17:33:23.113179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:58:29.983143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1345,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.526696+0000","last_change":"2024-06-11T17:18:20.576662+0000","last_active":"2024-06-11T17:33:23.526696+0000","last_peered":"2024-06-11T17:33:23.526696+0000","last_clean":"2024-06-11T17:33:23.526696+0000","last_became_active":"2024-06-11T17:18:20.575851+0000","last_became_peered":"2024-06-11T17:18:20.575851+0000","last_unstale":"2024-06-11T17:33:23.526696+0000","last_undegraded":"2024-06-11T17:33:23.526696+0000","last_fullsized":"2024-06-11T17:33:23.526696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:49:51.271037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1343,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.296212+0000","last_change":"2024-06-11T17:19:20.111865+0000","last_active":"2024-06-11T17:33:23.296212+0000","last_peered":"2024-06-11T17:33:23.296212+0000","last_clean":"2024-06-11T17:33:23.296212+0000","last_became_active":"2024-06-11T17:19:20.106199+0000","last_became_peered":"2024-06-11T17:19:20.106199+0000","last_unstale":"2024-06-11T17:33:23.296212+0000","last_undegraded":"2024-06-11T17:33:23.296212+0000","last_fullsized":"2024-06-11T17:33:23.296212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:03:31.736728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1364,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:24.072848+0000","last_change":"2024-06-11T17:18:20.572075+0000","last_active":"2024-06-11T17:33:24.072848+0000","last_peered":"2024-06-11T17:33:24.072848+0000","last_clean":"2024-06-11T17:33:24.072848+0000","last_became_active":"2024-06-11T17:18:20.571627+0000","last_became_peered":"2024-06-11T17:18:20.571627+0000","last_unstale":"2024-06-11T17:33:24.072848+0000","last_undegraded":"2024-06-11T17:33:24.072848+0000","last_fullsized":"2024-06-11T17:33:24.072848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:15:20.179876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1373,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.298616+0000","last_change":"2024-06-11T17:19:20.205257+0000","last_active":"2024-06-11T17:33:23.298616+0000","last_peered":"2024-06-11T17:33:23.298616+0000","last_clean":"2024-06-11T17:33:23.298616+0000","last_became_active":"2024-06-11T17:19:20.205013+0000","last_became_peered":"2024-06-11T17:19:20.205013+0000","last_unstale":"2024-06-11T17:33:23.298616+0000","last_undegraded":"2024-06-11T17:33:23.298616+0000","last_fullsized":"2024-06-11T17:33:23.298616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:28:05.365948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1358,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.763896+0000","last_change":"2024-06-11T17:18:20.576498+0000","last_active":"2024-06-11T17:33:23.763896+0000","last_peered":"2024-06-11T17:33:23.763896+0000","last_clean":"2024-06-11T17:33:23.763896+0000","last_became_active":"2024-06-11T17:18:20.575917+0000","last_became_peered":"2024-06-11T17:18:20.575917+0000","last_unstale":"2024-06-11T17:33:23.763896+0000","last_undegraded":"2024-06-11T17:33:23.763896+0000","last_fullsized":"2024-06-11T17:33:23.763896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:41:38.453105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1351,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.763714+0000","last_change":"2024-06-11T17:19:20.256793+0000","last_active":"2024-06-11T17:33:23.763714+0000","last_peered":"2024-06-11T17:33:23.763714+0000","last_clean":"2024-06-11T17:33:23.763714+0000","last_became_active":"2024-06-11T17:19:20.256125+0000","last_became_peered":"2024-06-11T17:19:20.256125+0000","last_unstale":"2024-06-11T17:33:23.763714+0000","last_undegraded":"2024-06-11T17:33:23.763714+0000","last_fullsized":"2024-06-11T17:33:23.763714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:49:16.819595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1350,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.298043+0000","last_change":"2024-06-11T17:18:20.656553+0000","last_active":"2024-06-11T17:33:23.298043+0000","last_peered":"2024-06-11T17:33:23.298043+0000","last_clean":"2024-06-11T17:33:23.298043+0000","last_became_active":"2024-06-11T17:18:20.656011+0000","last_became_peered":"2024-06-11T17:18:20.656011+0000","last_unstale":"2024-06-11T17:33:23.298043+0000","last_undegraded":"2024-06-11T17:33:23.298043+0000","last_fullsized":"2024-06-11T17:33:23.298043+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:10:47.950547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1349,"reported_epoch":701,"state":"active+clean","last_fresh":"2024-06-11T17:33:24.294965+0000","last_change":"2024-06-11T17:19:20.131816+0000","last_active":"2024-06-11T17:33:24.294965+0000","last_peered":"2024-06-11T17:33:24.294965+0000","last_clean":"2024-06-11T17:33:24.294965+0000","last_became_active":"2024-06-11T17:19:20.129276+0000","last_became_peered":"2024-06-11T17:19:20.129276+0000","last_unstale":"2024-06-11T17:33:24.294965+0000","last_undegraded":"2024-06-11T17:33:24.294965+0000","last_fullsized":"2024-06-11T17:33:24.294965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:41:04.135732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1345,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.526871+0000","last_change":"2024-06-11T17:18:20.659201+0000","last_active":"2024-06-11T17:33:23.526871+0000","last_peered":"2024-06-11T17:33:23.526871+0000","last_clean":"2024-06-11T17:33:23.526871+0000","last_became_active":"2024-06-11T17:18:20.658322+0000","last_became_peered":"2024-06-11T17:18:20.658322+0000","last_unstale":"2024-06-11T17:33:23.526871+0000","last_undegraded":"2024-06-11T17:33:23.526871+0000","last_fullsized":"2024-06-11T17:33:23.526871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T05:15:44.549344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1373,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.296005+0000","last_change":"2024-06-11T17:19:20.211466+0000","last_active":"2024-06-11T17:33:23.296005+0000","last_peered":"2024-06-11T17:33:23.296005+0000","last_clean":"2024-06-11T17:33:23.296005+0000","last_became_active":"2024-06-11T17:19:20.206654+0000","last_became_peered":"2024-06-11T17:19:20.206654+0000","last_unstale":"2024-06-11T17:33:23.296005+0000","last_undegraded":"2024-06-11T17:33:23.296005+0000","last_fullsized":"2024-06-11T17:33:23.296005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:07:31.495499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1349,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.295175+0000","last_change":"2024-06-11T17:18:20.573579+0000","last_active":"2024-06-11T17:33:23.295175+0000","last_peered":"2024-06-11T17:33:23.295175+0000","last_clean":"2024-06-11T17:33:23.295175+0000","last_became_active":"2024-06-11T17:18:20.573196+0000","last_became_peered":"2024-06-11T17:18:20.573196+0000","last_unstale":"2024-06-11T17:33:23.295175+0000","last_undegraded":"2024-06-11T17:33:23.295175+0000","last_fullsized":"2024-06-11T17:33:23.295175+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:32:09.705134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1349,"reported_epoch":701,"state":"active+clean","last_fresh":"2024-06-11T17:33:24.295365+0000","last_change":"2024-06-11T17:19:20.099973+0000","last_active":"2024-06-11T17:33:24.295365+0000","last_peered":"2024-06-11T17:33:24.295365+0000","last_clean":"2024-06-11T17:33:24.295365+0000","last_became_active":"2024-06-11T17:19:20.099516+0000","last_became_peered":"2024-06-11T17:19:20.099516+0000","last_unstale":"2024-06-11T17:33:24.295365+0000","last_undegraded":"2024-06-11T17:33:24.295365+0000","last_fullsized":"2024-06-11T17:33:24.295365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:51:48.484268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1349,"reported_epoch":699,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.116629+0000","last_change":"2024-06-11T17:18:20.575070+0000","last_active":"2024-06-11T17:33:23.116629+0000","last_peered":"2024-06-11T17:33:23.116629+0000","last_clean":"2024-06-11T17:33:23.116629+0000","last_became_active":"2024-06-11T17:18:20.574485+0000","last_became_peered":"2024-06-11T17:18:20.574485+0000","last_unstale":"2024-06-11T17:33:23.116629+0000","last_undegraded":"2024-06-11T17:33:23.116629+0000","last_fullsized":"2024-06-11T17:33:23.116629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:57.544403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1351,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.764358+0000","last_change":"2024-06-11T17:19:20.217640+0000","last_active":"2024-06-11T17:33:23.764358+0000","last_peered":"2024-06-11T17:33:23.764358+0000","last_clean":"2024-06-11T17:33:23.764358+0000","last_became_active":"2024-06-11T17:19:20.216412+0000","last_became_peered":"2024-06-11T17:19:20.216412+0000","last_unstale":"2024-06-11T17:33:23.764358+0000","last_undegraded":"2024-06-11T17:33:23.764358+0000","last_fullsized":"2024-06-11T17:33:23.764358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:37:52.624679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1349,"reported_epoch":701,"state":"active+clean","last_fresh":"2024-06-11T17:33:24.295066+0000","last_change":"2024-06-11T17:19:20.160954+0000","last_active":"2024-06-11T17:33:24.295066+0000","last_peered":"2024-06-11T17:33:24.295066+0000","last_clean":"2024-06-11T17:33:24.295066+0000","last_became_active":"2024-06-11T17:19:20.148798+0000","last_became_peered":"2024-06-11T17:19:20.148798+0000","last_unstale":"2024-06-11T17:33:24.295066+0000","last_undegraded":"2024-06-11T17:33:24.295066+0000","last_fullsized":"2024-06-11T17:33:24.295066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:14:04.308395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1374,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.297973+0000","last_change":"2024-06-11T17:19:20.127532+0000","last_active":"2024-06-11T17:33:23.297973+0000","last_peered":"2024-06-11T17:33:23.297973+0000","last_clean":"2024-06-11T17:33:23.297973+0000","last_became_active":"2024-06-11T17:19:20.125396+0000","last_became_peered":"2024-06-11T17:19:20.125396+0000","last_unstale":"2024-06-11T17:33:23.297973+0000","last_undegraded":"2024-06-11T17:33:23.297973+0000","last_fullsized":"2024-06-11T17:33:23.297973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:13:54.402896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1348,"reported_epoch":701,"state":"active+clean","last_fresh":"2024-06-11T17:33:24.294999+0000","last_change":"2024-06-11T17:19:20.227383+0000","last_active":"2024-06-11T17:33:24.294999+0000","last_peered":"2024-06-11T17:33:24.294999+0000","last_clean":"2024-06-11T17:33:24.294999+0000","last_became_active":"2024-06-11T17:19:20.226102+0000","last_became_peered":"2024-06-11T17:19:20.226102+0000","last_unstale":"2024-06-11T17:33:24.294999+0000","last_undegraded":"2024-06-11T17:33:24.294999+0000","last_fullsized":"2024-06-11T17:33:24.294999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:38:59.394056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1350,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.764217+0000","last_change":"2024-06-11T17:19:20.211934+0000","last_active":"2024-06-11T17:33:23.764217+0000","last_peered":"2024-06-11T17:33:23.764217+0000","last_clean":"2024-06-11T17:33:23.764217+0000","last_became_active":"2024-06-11T17:19:20.211650+0000","last_became_peered":"2024-06-11T17:19:20.211650+0000","last_unstale":"2024-06-11T17:33:23.764217+0000","last_undegraded":"2024-06-11T17:33:23.764217+0000","last_fullsized":"2024-06-11T17:33:23.764217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:53:48.110520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1373,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.298448+0000","last_change":"2024-06-11T17:19:20.093172+0000","last_active":"2024-06-11T17:33:23.298448+0000","last_peered":"2024-06-11T17:33:23.298448+0000","last_clean":"2024-06-11T17:33:23.298448+0000","last_became_active":"2024-06-11T17:19:20.092900+0000","last_became_peered":"2024-06-11T17:19:20.092900+0000","last_unstale":"2024-06-11T17:33:23.298448+0000","last_undegraded":"2024-06-11T17:33:23.298448+0000","last_fullsized":"2024-06-11T17:33:23.298448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:00:19.896831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1343,"reported_epoch":699,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.114919+0000","last_change":"2024-06-11T17:19:20.164400+0000","last_active":"2024-06-11T17:33:23.114919+0000","last_peered":"2024-06-11T17:33:23.114919+0000","last_clean":"2024-06-11T17:33:23.114919+0000","last_became_active":"2024-06-11T17:19:20.164153+0000","last_became_peered":"2024-06-11T17:19:20.164153+0000","last_unstale":"2024-06-11T17:33:23.114919+0000","last_undegraded":"2024-06-11T17:33:23.114919+0000","last_fullsized":"2024-06-11T17:33:23.114919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:47:00.884490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1351,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.764152+0000","last_change":"2024-06-11T17:19:20.217817+0000","last_active":"2024-06-11T17:33:23.764152+0000","last_peered":"2024-06-11T17:33:23.764152+0000","last_clean":"2024-06-11T17:33:23.764152+0000","last_became_active":"2024-06-11T17:19:20.211450+0000","last_became_peered":"2024-06-11T17:19:20.211450+0000","last_unstale":"2024-06-11T17:33:23.764152+0000","last_undegraded":"2024-06-11T17:33:23.764152+0000","last_fullsized":"2024-06-11T17:33:23.764152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:44:15.159723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1338,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.526423+0000","last_change":"2024-06-11T17:19:20.166503+0000","last_active":"2024-06-11T17:33:23.526423+0000","last_peered":"2024-06-11T17:33:23.526423+0000","last_clean":"2024-06-11T17:33:23.526423+0000","last_became_active":"2024-06-11T17:19:20.157763+0000","last_became_peered":"2024-06-11T17:19:20.157763+0000","last_unstale":"2024-06-11T17:33:23.526423+0000","last_undegraded":"2024-06-11T17:33:23.526423+0000","last_fullsized":"2024-06-11T17:33:23.526423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:07:50.951659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1337,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.526720+0000","last_change":"2024-06-11T17:19:20.180845+0000","last_active":"2024-06-11T17:33:23.526720+0000","last_peered":"2024-06-11T17:33:23.526720+0000","last_clean":"2024-06-11T17:33:23.526720+0000","last_became_active":"2024-06-11T17:19:20.180567+0000","last_became_peered":"2024-06-11T17:19:20.180567+0000","last_unstale":"2024-06-11T17:33:23.526720+0000","last_undegraded":"2024-06-11T17:33:23.526720+0000","last_fullsized":"2024-06-11T17:33:23.526720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:52:09.732771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1372,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.297822+0000","last_change":"2024-06-11T17:19:20.093495+0000","last_active":"2024-06-11T17:33:23.297822+0000","last_peered":"2024-06-11T17:33:23.297822+0000","last_clean":"2024-06-11T17:33:23.297822+0000","last_became_active":"2024-06-11T17:19:20.092534+0000","last_became_peered":"2024-06-11T17:19:20.092534+0000","last_unstale":"2024-06-11T17:33:23.297822+0000","last_undegraded":"2024-06-11T17:33:23.297822+0000","last_fullsized":"2024-06-11T17:33:23.297822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:57:08.203552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1337,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.526854+0000","last_change":"2024-06-11T17:19:20.221309+0000","last_active":"2024-06-11T17:33:23.526854+0000","last_peered":"2024-06-11T17:33:23.526854+0000","last_clean":"2024-06-11T17:33:23.526854+0000","last_became_active":"2024-06-11T17:19:20.212735+0000","last_became_peered":"2024-06-11T17:19:20.212735+0000","last_unstale":"2024-06-11T17:33:23.526854+0000","last_undegraded":"2024-06-11T17:33:23.526854+0000","last_fullsized":"2024-06-11T17:33:23.526854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:05:51.985748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1353,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.298894+0000","last_change":"2024-06-11T17:19:20.245137+0000","last_active":"2024-06-11T17:33:23.298894+0000","last_peered":"2024-06-11T17:33:23.298894+0000","last_clean":"2024-06-11T17:33:23.298894+0000","last_became_active":"2024-06-11T17:19:20.244248+0000","last_became_peered":"2024-06-11T17:19:20.244248+0000","last_unstale":"2024-06-11T17:33:23.298894+0000","last_undegraded":"2024-06-11T17:33:23.298894+0000","last_fullsized":"2024-06-11T17:33:23.298894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:59:08.798157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542328,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72484,"kb_used_data":9348,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94299356,"statfs":{"total":96636764160,"available":96562540544,"internally_reserved":0,"allocated":9572352,"data_stored":5150797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":64616906},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542330,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71952,"kb_used_data":8832,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94299888,"statfs":{"total":96636764160,"available":96563085312,"internally_reserved":0,"allocated":9043968,"data_stored":4635753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542329,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84436,"kb_used_data":8828,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94287404,"statfs":{"total":96636764160,"available":96550301696,"internally_reserved":0,"allocated":9039872,"data_stored":4621869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542330,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72040,"kb_used_data":8920,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94299800,"statfs":{"total":96636764160,"available":96562995200,"internally_reserved":0,"allocated":9134080,"data_stored":4716077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542329,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72488,"kb_used_data":9368,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94299352,"statfs":{"total":96636764160,"available":96562536448,"internally_reserved":0,"allocated":9592832,"data_stored":5176974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575032,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84440,"kb_used_data":8840,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94287400,"statfs":{"total":96636764160,"available":96550297600,"internally_reserved":0,"allocated":9052160,"data_stored":4653623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575032,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62296,"kb_used_data":8896,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94309544,"statfs":{"total":96636764160,"available":96572973056,"internally_reserved":0,"allocated":9109504,"data_stored":4701289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575034,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84512,"kb_used_data":8904,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94287328,"statfs":{"total":96636764160,"available":96550223872,"internally_reserved":0,"allocated":9117696,"data_stored":4715068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-11T17:33:26.262 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-11T17:33:26.378 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.381+0000 7fe075578640 1 Processor -- start 2024-06-11T17:33:26.379 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.381+0000 7fe075578640 1 -- start start 2024-06-11T17:33:26.381 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.381+0000 7fe075578640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe0700aca80 0x7fe07013dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:26.381 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.381+0000 7fe075578640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe07013e280 0x7fe070140be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:26.381 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.381+0000 7fe075578640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0700aede0 con 0x7fe070141120 2024-06-11T17:33:26.381 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.381+0000 7fe075578640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fe0700ad790 con 0x7fe0700aca80 2024-06-11T17:33:26.381 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.381+0000 7fe075578640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fe0700adbe0 con 0x7fe07013e280 2024-06-11T17:33:26.381 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.381+0000 7fe06effd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe0700aca80 0x7fe07013dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:26.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.381+0000 7fe06f7fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fe070141120 0x7fe070143ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:40932/0 (socket says 172.21.15.130:40932) 2024-06-11T17:33:26.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.381+0000 7fe06f7fe640 1 -- 172.21.15.130:0/793127806 learned_addr learned my addr 172.21.15.130:0/793127806 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-06-11T17:33:26.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.381+0000 7fe067fff640 1 --2- 172.21.15.130:0/793127806 >> v2:172.21.15.172:3300/0 conn(0x7fe07013e280 0x7fe070140be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:26.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.381+0000 7fe06e7fc640 1 -- 172.21.15.130:0/793127806 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 241420666 0 0) 0x7fe0700aede0 con 0x7fe070141120 2024-06-11T17:33:26.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.381+0000 7fe06e7fc640 1 -- 172.21.15.130:0/793127806 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe05c003530 con 0x7fe070141120 2024-06-11T17:33:26.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.381+0000 7fe06effd640 1 -- 172.21.15.130:0/793127806 >> v2:172.21.15.172:3300/0 conn(0x7fe07013e280 msgr2=0x7fe070140be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:33:26.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.381+0000 7fe06effd640 1 --2- 172.21.15.130:0/793127806 >> v2:172.21.15.172:3300/0 conn(0x7fe07013e280 0x7fe070140be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:26.383 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.381+0000 7fe06effd640 1 -- 172.21.15.130:0/793127806 >> v1:172.21.15.130:6789/0 conn(0x7fe070141120 legacy=0x7fe070143ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:26.383 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.381+0000 7fe06e7fc640 1 -- 172.21.15.130:0/793127806 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3983578961 0 0) 0x7fe05c003530 con 0x7fe070141120 2024-06-11T17:33:26.383 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.381+0000 7fe06effd640 1 -- 172.21.15.130:0/793127806 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0700ad240 con 0x7fe0700aca80 2024-06-11T17:33:26.383 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.381+0000 7fe067fff640 1 --2- 172.21.15.130:0/793127806 >> v2:172.21.15.172:3300/0 conn(0x7fe07013e280 0x7fe070140be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-11T17:33:26.384 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.385+0000 7fe06effd640 1 --2- 172.21.15.130:0/793127806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0700aca80 0x7fe07013dd40 secure :-1 s=READY pgs=4039 cs=0 l=1 rev1=1 crypto rx=0x7fe0700b0cc0 tx=0x7fe06001c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217b1d61ada00853 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:26.384 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.385+0000 7fe06e7fc640 1 -- 172.21.15.130:0/793127806 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0600b0070 con 0x7fe0700aca80 2024-06-11T17:33:26.384 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.385+0000 7fe06e7fc640 1 -- 172.21.15.130:0/793127806 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0600ab400 con 0x7fe0700aca80 2024-06-11T17:33:26.385 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.385+0000 7fe06e7fc640 1 -- 172.21.15.130:0/793127806 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe068001a80 con 0x7fe0700aca80 2024-06-11T17:33:26.385 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.385+0000 7fe075578640 1 -- 172.21.15.130:0/793127806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0700aca80 msgr2=0x7fe07013dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:26.385 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.385+0000 7fe075578640 1 --2- 172.21.15.130:0/793127806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0700aca80 0x7fe07013dd40 secure :-1 s=READY pgs=4039 cs=0 l=1 rev1=1 crypto rx=0x7fe0700b0cc0 tx=0x7fe06001c2f0 comp rx=0 tx=0).stop 2024-06-11T17:33:26.385 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.385+0000 7fe075578640 1 -- 172.21.15.130:0/793127806 shutdown_connections 2024-06-11T17:33:26.385 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.385+0000 7fe075578640 1 --2- 172.21.15.130:0/793127806 >> v2:172.21.15.172:3300/0 conn(0x7fe07013e280 0x7fe070140be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:26.385 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.385+0000 7fe075578640 1 --2- 172.21.15.130:0/793127806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0700aca80 0x7fe07013dd40 unknown :-1 s=CLOSED pgs=4039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:26.386 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.385+0000 7fe075578640 1 -- 172.21.15.130:0/793127806 >> 172.21.15.130:0/793127806 conn(0x7fe0700b46b0 msgr2=0x7fe0700b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:26.386 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.385+0000 7fe075578640 1 -- 172.21.15.130:0/793127806 shutdown_connections 2024-06-11T17:33:26.386 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.385+0000 7fe075578640 1 -- 172.21.15.130:0/793127806 wait complete. 2024-06-11T17:33:26.389 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.385+0000 7fe075578640 1 Processor -- start 2024-06-11T17:33:26.389 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.385+0000 7fe075578640 1 -- start start 2024-06-11T17:33:26.389 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.385+0000 7fe075578640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0700aca80 0x7fe070145bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:26.389 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.385+0000 7fe075578640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe07013e280 0x7fe0700711b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:26.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.385+0000 7fe075578640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe070141120 0x7fe0700716f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:26.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.385+0000 7fe075578640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe07014e400 con 0x7fe07013e280 2024-06-11T17:33:26.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.385+0000 7fe075578640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe070073dc0 con 0x7fe0700aca80 2024-06-11T17:33:26.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.385+0000 7fe075578640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe07014e580 con 0x7fe070141120 2024-06-11T17:33:26.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.385+0000 7fe067fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe07013e280 0x7fe0700711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:26.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.385+0000 7fe06f7fe640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe070141120 0x7fe0700716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:26.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.385+0000 7fe067fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe07013e280 0x7fe0700711b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44104/0 (socket says 172.21.15.130:44104) 2024-06-11T17:33:26.391 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.385+0000 7fe067fff640 1 -- 172.21.15.130:0/1114744117 learned_addr learned my addr 172.21.15.130:0/1114744117 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:33:26.391 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.385+0000 7fe06effd640 1 --2- 172.21.15.130:0/1114744117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0700aca80 0x7fe070145bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:26.391 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.385+0000 7fe067fff640 1 -- 172.21.15.130:0/1114744117 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe070141120 msgr2=0x7fe0700716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:26.391 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.385+0000 7fe067fff640 1 --2- 172.21.15.130:0/1114744117 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe070141120 0x7fe0700716f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:26.391 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.385+0000 7fe067fff640 1 -- 172.21.15.130:0/1114744117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0700aca80 msgr2=0x7fe070145bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:26.391 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.385+0000 7fe067fff640 1 --2- 172.21.15.130:0/1114744117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0700aca80 0x7fe070145bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:26.391 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.385+0000 7fe067fff640 1 -- 172.21.15.130:0/1114744117 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe070147fc0 con 0x7fe07013e280 2024-06-11T17:33:26.391 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.385+0000 7fe067fff640 1 --2- 172.21.15.130:0/1114744117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe07013e280 0x7fe0700711b0 secure :-1 s=READY pgs=4040 cs=0 l=1 rev1=1 crypto rx=0x7fe05800e810 tx=0x7fe05800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:26.391 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.389+0000 7fe0677fe640 1 -- 172.21.15.130:0/1114744117 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe058017070 con 0x7fe07013e280 2024-06-11T17:33:26.392 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.389+0000 7fe0677fe640 1 -- 172.21.15.130:0/1114744117 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe05800c8d0 con 0x7fe07013e280 2024-06-11T17:33:26.392 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.389+0000 7fe075578640 1 -- 172.21.15.130:0/1114744117 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe070146b10 con 0x7fe07013e280 2024-06-11T17:33:26.392 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.389+0000 7fe0677fe640 1 -- 172.21.15.130:0/1114744117 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05800f040 con 0x7fe07013e280 2024-06-11T17:33:26.392 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.389+0000 7fe075578640 1 -- 172.21.15.130:0/1114744117 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe070146100 con 0x7fe07013e280 2024-06-11T17:33:26.392 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.389+0000 7fe075578640 1 -- 172.21.15.130:0/1114744117 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe07013dd40 con 0x7fe07013e280 2024-06-11T17:33:26.392 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.389+0000 7fe0677fe640 1 -- 172.21.15.130:0/1114744117 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7fe05801a070 con 0x7fe07013e280 2024-06-11T17:33:26.392 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.389+0000 7fe0677fe640 1 --2- 172.21.15.130:0/1114744117 >> v2:172.21.15.130:6816/3863300924 conn(0x7fe050070d60 0x7fe050073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:26.392 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.389+0000 7fe06effd640 1 --2- 172.21.15.130:0/1114744117 >> v2:172.21.15.130:6816/3863300924 conn(0x7fe050070d60 0x7fe050073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:26.392 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.389+0000 7fe0677fe640 1 -- 172.21.15.130:0/1114744117 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(702..702 src has 82..702) ==== 5253+0+0 (secure 0 0 0) 0x7fe058090de0 con 0x7fe07013e280 2024-06-11T17:33:26.393 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.389+0000 7fe06effd640 1 --2- 172.21.15.130:0/1114744117 >> v2:172.21.15.130:6816/3863300924 conn(0x7fe050070d60 0x7fe050073220 secure :-1 s=READY pgs=3436 cs=0 l=1 rev1=1 crypto rx=0x7fe0600ad000 tx=0x7fe0600a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:26.393 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.393+0000 7fe0677fe640 1 -- 172.21.15.130:0/1114744117 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7fe070146b10 con 0x7fe07013e280 2024-06-11T17:33:26.548 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.549+0000 7fe075578640 1 -- 172.21.15.130:0/1114744117 --> v2:172.21.15.130:6816/3863300924 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe07013dfe0 con 0x7fe050070d60 2024-06-11T17:33:26.550 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.553+0000 7fe0677fe640 1 -- 172.21.15.130:0/1114744117 <== mgr.4107 v2:172.21.15.130:6816/3863300924 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+116183 (secure 0 0 0) 0x7fe07013dfe0 con 0x7fe050070d60 2024-06-11T17:33:26.552 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:33:26.552 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2024-06-11T17:33:26.554 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.553+0000 7fe075578640 1 -- 172.21.15.130:0/1114744117 >> v2:172.21.15.130:6816/3863300924 conn(0x7fe050070d60 msgr2=0x7fe050073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:26.554 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.553+0000 7fe075578640 1 --2- 172.21.15.130:0/1114744117 >> v2:172.21.15.130:6816/3863300924 conn(0x7fe050070d60 0x7fe050073220 secure :-1 s=READY pgs=3436 cs=0 l=1 rev1=1 crypto rx=0x7fe0600ad000 tx=0x7fe0600a6000 comp rx=0 tx=0).stop 2024-06-11T17:33:26.554 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.553+0000 7fe075578640 1 -- 172.21.15.130:0/1114744117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe07013e280 msgr2=0x7fe0700711b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:26.554 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.553+0000 7fe075578640 1 --2- 172.21.15.130:0/1114744117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe07013e280 0x7fe0700711b0 secure :-1 s=READY pgs=4040 cs=0 l=1 rev1=1 crypto rx=0x7fe05800e810 tx=0x7fe05800ecd0 comp rx=0 tx=0).stop 2024-06-11T17:33:26.554 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.553+0000 7fe075578640 1 -- 172.21.15.130:0/1114744117 shutdown_connections 2024-06-11T17:33:26.555 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.553+0000 7fe075578640 1 --2- 172.21.15.130:0/1114744117 >> v2:172.21.15.130:6816/3863300924 conn(0x7fe050070d60 0x7fe050073220 unknown :-1 s=CLOSED pgs=3436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:26.555 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.553+0000 7fe075578640 1 --2- 172.21.15.130:0/1114744117 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe070141120 0x7fe0700716f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:26.555 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.553+0000 7fe075578640 1 --2- 172.21.15.130:0/1114744117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe07013e280 0x7fe0700711b0 unknown :-1 s=CLOSED pgs=4040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:26.555 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.553+0000 7fe075578640 1 --2- 172.21.15.130:0/1114744117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0700aca80 0x7fe070145bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:26.555 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.553+0000 7fe075578640 1 -- 172.21.15.130:0/1114744117 >> 172.21.15.130:0/1114744117 conn(0x7fe0700b46b0 msgr2=0x7fe0700aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:26.555 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.553+0000 7fe075578640 1 -- 172.21.15.130:0/1114744117 shutdown_connections 2024-06-11T17:33:26.555 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.553+0000 7fe075578640 1 -- 172.21.15.130:0/1114744117 wait complete. 2024-06-11T17:33:26.569 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":1149,"stamp":"2024-06-11T17:33:25.309401+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590373,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":61,"num_write":108,"num_write_kb":1635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":139,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":604648,"kb_used_data":71936,"kb_used_omap":12,"kb_used_meta":532531,"kb_avail":754370072,"statfs":{"total":773094113280,"available":772474953728,"internally_reserved":0,"allocated":73662464,"data_stored":38371450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":545312306},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4000299,"num_objects":-44,"num_object_clones":-1,"num_object_copies":-132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-44,"num_whiteouts":0,"num_read":-31,"num_read_kb":-11,"num_write":-71,"num_write_kb":-3969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":-1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.038794"},"pg_stats":[{"pgid":"8.18","version":"0'0","reported_seq":1352,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.298489+0000","last_change":"2024-06-11T17:19:20.252042+0000","last_active":"2024-06-11T17:33:23.298489+0000","last_peered":"2024-06-11T17:33:23.298489+0000","last_clean":"2024-06-11T17:33:23.298489+0000","last_became_active":"2024-06-11T17:19:20.245039+0000","last_became_peered":"2024-06-11T17:19:20.245039+0000","last_unstale":"2024-06-11T17:33:23.298489+0000","last_undegraded":"2024-06-11T17:33:23.298489+0000","last_fullsized":"2024-06-11T17:33:23.298489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:37.254125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1350,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.763955+0000","last_change":"2024-06-11T17:19:20.146092+0000","last_active":"2024-06-11T17:33:23.763955+0000","last_peered":"2024-06-11T17:33:23.763955+0000","last_clean":"2024-06-11T17:33:23.763955+0000","last_became_active":"2024-06-11T17:19:20.143262+0000","last_became_peered":"2024-06-11T17:19:20.143262+0000","last_unstale":"2024-06-11T17:33:23.763955+0000","last_undegraded":"2024-06-11T17:33:23.763955+0000","last_fullsized":"2024-06-11T17:33:23.763955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:24:15.418401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1348,"reported_epoch":701,"state":"active+clean","last_fresh":"2024-06-11T17:33:24.294973+0000","last_change":"2024-06-11T17:19:20.166997+0000","last_active":"2024-06-11T17:33:24.294973+0000","last_peered":"2024-06-11T17:33:24.294973+0000","last_clean":"2024-06-11T17:33:24.294973+0000","last_became_active":"2024-06-11T17:19:20.165147+0000","last_became_peered":"2024-06-11T17:19:20.165147+0000","last_unstale":"2024-06-11T17:33:24.294973+0000","last_undegraded":"2024-06-11T17:33:24.294973+0000","last_fullsized":"2024-06-11T17:33:24.294973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:08:34.862959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1352,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.299522+0000","last_change":"2024-06-11T17:19:20.204932+0000","last_active":"2024-06-11T17:33:23.299522+0000","last_peered":"2024-06-11T17:33:23.299522+0000","last_clean":"2024-06-11T17:33:23.299522+0000","last_became_active":"2024-06-11T17:19:20.204104+0000","last_became_peered":"2024-06-11T17:19:20.204104+0000","last_unstale":"2024-06-11T17:33:23.299522+0000","last_undegraded":"2024-06-11T17:33:23.299522+0000","last_fullsized":"2024-06-11T17:33:23.299522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:22:09.289002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1350,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.764217+0000","last_change":"2024-06-11T17:19:20.142647+0000","last_active":"2024-06-11T17:33:23.764217+0000","last_peered":"2024-06-11T17:33:23.764217+0000","last_clean":"2024-06-11T17:33:23.764217+0000","last_became_active":"2024-06-11T17:19:20.141398+0000","last_became_peered":"2024-06-11T17:19:20.141398+0000","last_unstale":"2024-06-11T17:33:23.764217+0000","last_undegraded":"2024-06-11T17:33:23.764217+0000","last_fullsized":"2024-06-11T17:33:23.764217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:37:49.933084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1343,"reported_epoch":699,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.115250+0000","last_change":"2024-06-11T17:19:20.195776+0000","last_active":"2024-06-11T17:33:23.115250+0000","last_peered":"2024-06-11T17:33:23.115250+0000","last_clean":"2024-06-11T17:33:23.115250+0000","last_became_active":"2024-06-11T17:19:20.192892+0000","last_became_peered":"2024-06-11T17:19:20.192892+0000","last_unstale":"2024-06-11T17:33:23.115250+0000","last_undegraded":"2024-06-11T17:33:23.115250+0000","last_fullsized":"2024-06-11T17:33:23.115250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T05:17:41.998549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1349,"reported_epoch":701,"state":"active+clean","last_fresh":"2024-06-11T17:33:24.295279+0000","last_change":"2024-06-11T17:19:20.175472+0000","last_active":"2024-06-11T17:33:24.295279+0000","last_peered":"2024-06-11T17:33:24.295279+0000","last_clean":"2024-06-11T17:33:24.295279+0000","last_became_active":"2024-06-11T17:19:20.175221+0000","last_became_peered":"2024-06-11T17:19:20.175221+0000","last_unstale":"2024-06-11T17:33:24.295279+0000","last_undegraded":"2024-06-11T17:33:24.295279+0000","last_fullsized":"2024-06-11T17:33:24.295279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T05:05:22.352892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1343,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.295333+0000","last_change":"2024-06-11T17:19:20.121498+0000","last_active":"2024-06-11T17:33:23.295333+0000","last_peered":"2024-06-11T17:33:23.295333+0000","last_clean":"2024-06-11T17:33:23.295333+0000","last_became_active":"2024-06-11T17:19:20.120302+0000","last_became_peered":"2024-06-11T17:19:20.120302+0000","last_unstale":"2024-06-11T17:33:23.295333+0000","last_undegraded":"2024-06-11T17:33:23.295333+0000","last_fullsized":"2024-06-11T17:33:23.295333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T05:14:47.533955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1374,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.296134+0000","last_change":"2024-06-11T17:19:20.243500+0000","last_active":"2024-06-11T17:33:23.296134+0000","last_peered":"2024-06-11T17:33:23.296134+0000","last_clean":"2024-06-11T17:33:23.296134+0000","last_became_active":"2024-06-11T17:19:20.243122+0000","last_became_peered":"2024-06-11T17:19:20.243122+0000","last_unstale":"2024-06-11T17:33:23.296134+0000","last_undegraded":"2024-06-11T17:33:23.296134+0000","last_fullsized":"2024-06-11T17:33:23.296134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:11:13.381933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1","version":"19'7","reported_seq":1356,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.294858+0000","last_change":"2024-06-11T17:19:20.192244+0000","last_active":"2024-06-11T17:33:23.294858+0000","last_peered":"2024-06-11T17:33:23.294858+0000","last_clean":"2024-06-11T17:33:23.294858+0000","last_became_active":"2024-06-11T17:19:20.191981+0000","last_became_peered":"2024-06-11T17:19:20.191981+0000","last_unstale":"2024-06-11T17:33:23.294858+0000","last_undegraded":"2024-06-11T17:33:23.294858+0000","last_fullsized":"2024-06-11T17:33:23.294858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:25:30.923332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1353,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.298585+0000","last_change":"2024-06-11T17:19:20.255611+0000","last_active":"2024-06-11T17:33:23.298585+0000","last_peered":"2024-06-11T17:33:23.298585+0000","last_clean":"2024-06-11T17:33:23.298585+0000","last_became_active":"2024-06-11T17:19:20.247875+0000","last_became_peered":"2024-06-11T17:19:20.247875+0000","last_unstale":"2024-06-11T17:33:23.298585+0000","last_undegraded":"2024-06-11T17:33:23.298585+0000","last_fullsized":"2024-06-11T17:33:23.298585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:31:10.443876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1343,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.294949+0000","last_change":"2024-06-11T17:19:20.250335+0000","last_active":"2024-06-11T17:33:23.294949+0000","last_peered":"2024-06-11T17:33:23.294949+0000","last_clean":"2024-06-11T17:33:23.294949+0000","last_became_active":"2024-06-11T17:19:20.250080+0000","last_became_peered":"2024-06-11T17:19:20.250080+0000","last_unstale":"2024-06-11T17:33:23.294949+0000","last_undegraded":"2024-06-11T17:33:23.294949+0000","last_fullsized":"2024-06-11T17:33:23.294949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:14:17.864074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":1435,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.526422+0000","last_change":"2024-06-11T17:18:20.659416+0000","last_active":"2024-06-11T17:33:23.526422+0000","last_peered":"2024-06-11T17:33:23.526422+0000","last_clean":"2024-06-11T17:33:23.526422+0000","last_became_active":"2024-06-11T17:18:20.657407+0000","last_became_peered":"2024-06-11T17:18:20.657407+0000","last_unstale":"2024-06-11T17:33:23.526422+0000","last_undegraded":"2024-06-11T17:33:23.526422+0000","last_fullsized":"2024-06-11T17:33:23.526422+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:15:37.551739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1358,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.764255+0000","last_change":"2024-06-11T17:18:20.575928+0000","last_active":"2024-06-11T17:33:23.764255+0000","last_peered":"2024-06-11T17:33:23.764255+0000","last_clean":"2024-06-11T17:33:23.764255+0000","last_became_active":"2024-06-11T17:18:20.575356+0000","last_became_peered":"2024-06-11T17:18:20.575356+0000","last_unstale":"2024-06-11T17:33:23.764255+0000","last_undegraded":"2024-06-11T17:33:23.764255+0000","last_fullsized":"2024-06-11T17:33:23.764255+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:57:32.714496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1343,"reported_epoch":699,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.113179+0000","last_change":"2024-06-11T17:19:20.247282+0000","last_active":"2024-06-11T17:33:23.113179+0000","last_peered":"2024-06-11T17:33:23.113179+0000","last_clean":"2024-06-11T17:33:23.113179+0000","last_became_active":"2024-06-11T17:19:20.238515+0000","last_became_peered":"2024-06-11T17:19:20.238515+0000","last_unstale":"2024-06-11T17:33:23.113179+0000","last_undegraded":"2024-06-11T17:33:23.113179+0000","last_fullsized":"2024-06-11T17:33:23.113179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:58:29.983143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1345,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.526696+0000","last_change":"2024-06-11T17:18:20.576662+0000","last_active":"2024-06-11T17:33:23.526696+0000","last_peered":"2024-06-11T17:33:23.526696+0000","last_clean":"2024-06-11T17:33:23.526696+0000","last_became_active":"2024-06-11T17:18:20.575851+0000","last_became_peered":"2024-06-11T17:18:20.575851+0000","last_unstale":"2024-06-11T17:33:23.526696+0000","last_undegraded":"2024-06-11T17:33:23.526696+0000","last_fullsized":"2024-06-11T17:33:23.526696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:49:51.271037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1343,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.296212+0000","last_change":"2024-06-11T17:19:20.111865+0000","last_active":"2024-06-11T17:33:23.296212+0000","last_peered":"2024-06-11T17:33:23.296212+0000","last_clean":"2024-06-11T17:33:23.296212+0000","last_became_active":"2024-06-11T17:19:20.106199+0000","last_became_peered":"2024-06-11T17:19:20.106199+0000","last_unstale":"2024-06-11T17:33:23.296212+0000","last_undegraded":"2024-06-11T17:33:23.296212+0000","last_fullsized":"2024-06-11T17:33:23.296212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:03:31.736728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1364,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:24.072848+0000","last_change":"2024-06-11T17:18:20.572075+0000","last_active":"2024-06-11T17:33:24.072848+0000","last_peered":"2024-06-11T17:33:24.072848+0000","last_clean":"2024-06-11T17:33:24.072848+0000","last_became_active":"2024-06-11T17:18:20.571627+0000","last_became_peered":"2024-06-11T17:18:20.571627+0000","last_unstale":"2024-06-11T17:33:24.072848+0000","last_undegraded":"2024-06-11T17:33:24.072848+0000","last_fullsized":"2024-06-11T17:33:24.072848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:15:20.179876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1373,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.298616+0000","last_change":"2024-06-11T17:19:20.205257+0000","last_active":"2024-06-11T17:33:23.298616+0000","last_peered":"2024-06-11T17:33:23.298616+0000","last_clean":"2024-06-11T17:33:23.298616+0000","last_became_active":"2024-06-11T17:19:20.205013+0000","last_became_peered":"2024-06-11T17:19:20.205013+0000","last_unstale":"2024-06-11T17:33:23.298616+0000","last_undegraded":"2024-06-11T17:33:23.298616+0000","last_fullsized":"2024-06-11T17:33:23.298616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:28:05.365948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1358,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.763896+0000","last_change":"2024-06-11T17:18:20.576498+0000","last_active":"2024-06-11T17:33:23.763896+0000","last_peered":"2024-06-11T17:33:23.763896+0000","last_clean":"2024-06-11T17:33:23.763896+0000","last_became_active":"2024-06-11T17:18:20.575917+0000","last_became_peered":"2024-06-11T17:18:20.575917+0000","last_unstale":"2024-06-11T17:33:23.763896+0000","last_undegraded":"2024-06-11T17:33:23.763896+0000","last_fullsized":"2024-06-11T17:33:23.763896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:41:38.453105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1351,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.763714+0000","last_change":"2024-06-11T17:19:20.256793+0000","last_active":"2024-06-11T17:33:23.763714+0000","last_peered":"2024-06-11T17:33:23.763714+0000","last_clean":"2024-06-11T17:33:23.763714+0000","last_became_active":"2024-06-11T17:19:20.256125+0000","last_became_peered":"2024-06-11T17:19:20.256125+0000","last_unstale":"2024-06-11T17:33:23.763714+0000","last_undegraded":"2024-06-11T17:33:23.763714+0000","last_fullsized":"2024-06-11T17:33:23.763714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:49:16.819595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1350,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.298043+0000","last_change":"2024-06-11T17:18:20.656553+0000","last_active":"2024-06-11T17:33:23.298043+0000","last_peered":"2024-06-11T17:33:23.298043+0000","last_clean":"2024-06-11T17:33:23.298043+0000","last_became_active":"2024-06-11T17:18:20.656011+0000","last_became_peered":"2024-06-11T17:18:20.656011+0000","last_unstale":"2024-06-11T17:33:23.298043+0000","last_undegraded":"2024-06-11T17:33:23.298043+0000","last_fullsized":"2024-06-11T17:33:23.298043+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:10:47.950547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1349,"reported_epoch":701,"state":"active+clean","last_fresh":"2024-06-11T17:33:24.294965+0000","last_change":"2024-06-11T17:19:20.131816+0000","last_active":"2024-06-11T17:33:24.294965+0000","last_peered":"2024-06-11T17:33:24.294965+0000","last_clean":"2024-06-11T17:33:24.294965+0000","last_became_active":"2024-06-11T17:19:20.129276+0000","last_became_peered":"2024-06-11T17:19:20.129276+0000","last_unstale":"2024-06-11T17:33:24.294965+0000","last_undegraded":"2024-06-11T17:33:24.294965+0000","last_fullsized":"2024-06-11T17:33:24.294965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:41:04.135732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1345,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.526871+0000","last_change":"2024-06-11T17:18:20.659201+0000","last_active":"2024-06-11T17:33:23.526871+0000","last_peered":"2024-06-11T17:33:23.526871+0000","last_clean":"2024-06-11T17:33:23.526871+0000","last_became_active":"2024-06-11T17:18:20.658322+0000","last_became_peered":"2024-06-11T17:18:20.658322+0000","last_unstale":"2024-06-11T17:33:23.526871+0000","last_undegraded":"2024-06-11T17:33:23.526871+0000","last_fullsized":"2024-06-11T17:33:23.526871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T05:15:44.549344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1373,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.296005+0000","last_change":"2024-06-11T17:19:20.211466+0000","last_active":"2024-06-11T17:33:23.296005+0000","last_peered":"2024-06-11T17:33:23.296005+0000","last_clean":"2024-06-11T17:33:23.296005+0000","last_became_active":"2024-06-11T17:19:20.206654+0000","last_became_peered":"2024-06-11T17:19:20.206654+0000","last_unstale":"2024-06-11T17:33:23.296005+0000","last_undegraded":"2024-06-11T17:33:23.296005+0000","last_fullsized":"2024-06-11T17:33:23.296005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:07:31.495499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1349,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.295175+0000","last_change":"2024-06-11T17:18:20.573579+0000","last_active":"2024-06-11T17:33:23.295175+0000","last_peered":"2024-06-11T17:33:23.295175+0000","last_clean":"2024-06-11T17:33:23.295175+0000","last_became_active":"2024-06-11T17:18:20.573196+0000","last_became_peered":"2024-06-11T17:18:20.573196+0000","last_unstale":"2024-06-11T17:33:23.295175+0000","last_undegraded":"2024-06-11T17:33:23.295175+0000","last_fullsized":"2024-06-11T17:33:23.295175+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:32:09.705134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1349,"reported_epoch":701,"state":"active+clean","last_fresh":"2024-06-11T17:33:24.295365+0000","last_change":"2024-06-11T17:19:20.099973+0000","last_active":"2024-06-11T17:33:24.295365+0000","last_peered":"2024-06-11T17:33:24.295365+0000","last_clean":"2024-06-11T17:33:24.295365+0000","last_became_active":"2024-06-11T17:19:20.099516+0000","last_became_peered":"2024-06-11T17:19:20.099516+0000","last_unstale":"2024-06-11T17:33:24.295365+0000","last_undegraded":"2024-06-11T17:33:24.295365+0000","last_fullsized":"2024-06-11T17:33:24.295365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:51:48.484268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1349,"reported_epoch":699,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.116629+0000","last_change":"2024-06-11T17:18:20.575070+0000","last_active":"2024-06-11T17:33:23.116629+0000","last_peered":"2024-06-11T17:33:23.116629+0000","last_clean":"2024-06-11T17:33:23.116629+0000","last_became_active":"2024-06-11T17:18:20.574485+0000","last_became_peered":"2024-06-11T17:18:20.574485+0000","last_unstale":"2024-06-11T17:33:23.116629+0000","last_undegraded":"2024-06-11T17:33:23.116629+0000","last_fullsized":"2024-06-11T17:33:23.116629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:57.544403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1351,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.764358+0000","last_change":"2024-06-11T17:19:20.217640+0000","last_active":"2024-06-11T17:33:23.764358+0000","last_peered":"2024-06-11T17:33:23.764358+0000","last_clean":"2024-06-11T17:33:23.764358+0000","last_became_active":"2024-06-11T17:19:20.216412+0000","last_became_peered":"2024-06-11T17:19:20.216412+0000","last_unstale":"2024-06-11T17:33:23.764358+0000","last_undegraded":"2024-06-11T17:33:23.764358+0000","last_fullsized":"2024-06-11T17:33:23.764358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:37:52.624679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1349,"reported_epoch":701,"state":"active+clean","last_fresh":"2024-06-11T17:33:24.295066+0000","last_change":"2024-06-11T17:19:20.160954+0000","last_active":"2024-06-11T17:33:24.295066+0000","last_peered":"2024-06-11T17:33:24.295066+0000","last_clean":"2024-06-11T17:33:24.295066+0000","last_became_active":"2024-06-11T17:19:20.148798+0000","last_became_peered":"2024-06-11T17:19:20.148798+0000","last_unstale":"2024-06-11T17:33:24.295066+0000","last_undegraded":"2024-06-11T17:33:24.295066+0000","last_fullsized":"2024-06-11T17:33:24.295066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:14:04.308395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1374,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.297973+0000","last_change":"2024-06-11T17:19:20.127532+0000","last_active":"2024-06-11T17:33:23.297973+0000","last_peered":"2024-06-11T17:33:23.297973+0000","last_clean":"2024-06-11T17:33:23.297973+0000","last_became_active":"2024-06-11T17:19:20.125396+0000","last_became_peered":"2024-06-11T17:19:20.125396+0000","last_unstale":"2024-06-11T17:33:23.297973+0000","last_undegraded":"2024-06-11T17:33:23.297973+0000","last_fullsized":"2024-06-11T17:33:23.297973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:13:54.402896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1348,"reported_epoch":701,"state":"active+clean","last_fresh":"2024-06-11T17:33:24.294999+0000","last_change":"2024-06-11T17:19:20.227383+0000","last_active":"2024-06-11T17:33:24.294999+0000","last_peered":"2024-06-11T17:33:24.294999+0000","last_clean":"2024-06-11T17:33:24.294999+0000","last_became_active":"2024-06-11T17:19:20.226102+0000","last_became_peered":"2024-06-11T17:19:20.226102+0000","last_unstale":"2024-06-11T17:33:24.294999+0000","last_undegraded":"2024-06-11T17:33:24.294999+0000","last_fullsized":"2024-06-11T17:33:24.294999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:38:59.394056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1350,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.764217+0000","last_change":"2024-06-11T17:19:20.211934+0000","last_active":"2024-06-11T17:33:23.764217+0000","last_peered":"2024-06-11T17:33:23.764217+0000","last_clean":"2024-06-11T17:33:23.764217+0000","last_became_active":"2024-06-11T17:19:20.211650+0000","last_became_peered":"2024-06-11T17:19:20.211650+0000","last_unstale":"2024-06-11T17:33:23.764217+0000","last_undegraded":"2024-06-11T17:33:23.764217+0000","last_fullsized":"2024-06-11T17:33:23.764217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:53:48.110520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1373,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.298448+0000","last_change":"2024-06-11T17:19:20.093172+0000","last_active":"2024-06-11T17:33:23.298448+0000","last_peered":"2024-06-11T17:33:23.298448+0000","last_clean":"2024-06-11T17:33:23.298448+0000","last_became_active":"2024-06-11T17:19:20.092900+0000","last_became_peered":"2024-06-11T17:19:20.092900+0000","last_unstale":"2024-06-11T17:33:23.298448+0000","last_undegraded":"2024-06-11T17:33:23.298448+0000","last_fullsized":"2024-06-11T17:33:23.298448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:00:19.896831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1343,"reported_epoch":699,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.114919+0000","last_change":"2024-06-11T17:19:20.164400+0000","last_active":"2024-06-11T17:33:23.114919+0000","last_peered":"2024-06-11T17:33:23.114919+0000","last_clean":"2024-06-11T17:33:23.114919+0000","last_became_active":"2024-06-11T17:19:20.164153+0000","last_became_peered":"2024-06-11T17:19:20.164153+0000","last_unstale":"2024-06-11T17:33:23.114919+0000","last_undegraded":"2024-06-11T17:33:23.114919+0000","last_fullsized":"2024-06-11T17:33:23.114919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:47:00.884490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1351,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.764152+0000","last_change":"2024-06-11T17:19:20.217817+0000","last_active":"2024-06-11T17:33:23.764152+0000","last_peered":"2024-06-11T17:33:23.764152+0000","last_clean":"2024-06-11T17:33:23.764152+0000","last_became_active":"2024-06-11T17:19:20.211450+0000","last_became_peered":"2024-06-11T17:19:20.211450+0000","last_unstale":"2024-06-11T17:33:23.764152+0000","last_undegraded":"2024-06-11T17:33:23.764152+0000","last_fullsized":"2024-06-11T17:33:23.764152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:44:15.159723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1338,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.526423+0000","last_change":"2024-06-11T17:19:20.166503+0000","last_active":"2024-06-11T17:33:23.526423+0000","last_peered":"2024-06-11T17:33:23.526423+0000","last_clean":"2024-06-11T17:33:23.526423+0000","last_became_active":"2024-06-11T17:19:20.157763+0000","last_became_peered":"2024-06-11T17:19:20.157763+0000","last_unstale":"2024-06-11T17:33:23.526423+0000","last_undegraded":"2024-06-11T17:33:23.526423+0000","last_fullsized":"2024-06-11T17:33:23.526423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:07:50.951659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1337,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.526720+0000","last_change":"2024-06-11T17:19:20.180845+0000","last_active":"2024-06-11T17:33:23.526720+0000","last_peered":"2024-06-11T17:33:23.526720+0000","last_clean":"2024-06-11T17:33:23.526720+0000","last_became_active":"2024-06-11T17:19:20.180567+0000","last_became_peered":"2024-06-11T17:19:20.180567+0000","last_unstale":"2024-06-11T17:33:23.526720+0000","last_undegraded":"2024-06-11T17:33:23.526720+0000","last_fullsized":"2024-06-11T17:33:23.526720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:52:09.732771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1372,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.297822+0000","last_change":"2024-06-11T17:19:20.093495+0000","last_active":"2024-06-11T17:33:23.297822+0000","last_peered":"2024-06-11T17:33:23.297822+0000","last_clean":"2024-06-11T17:33:23.297822+0000","last_became_active":"2024-06-11T17:19:20.092534+0000","last_became_peered":"2024-06-11T17:19:20.092534+0000","last_unstale":"2024-06-11T17:33:23.297822+0000","last_undegraded":"2024-06-11T17:33:23.297822+0000","last_fullsized":"2024-06-11T17:33:23.297822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:57:08.203552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1337,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.526854+0000","last_change":"2024-06-11T17:19:20.221309+0000","last_active":"2024-06-11T17:33:23.526854+0000","last_peered":"2024-06-11T17:33:23.526854+0000","last_clean":"2024-06-11T17:33:23.526854+0000","last_became_active":"2024-06-11T17:19:20.212735+0000","last_became_peered":"2024-06-11T17:19:20.212735+0000","last_unstale":"2024-06-11T17:33:23.526854+0000","last_undegraded":"2024-06-11T17:33:23.526854+0000","last_fullsized":"2024-06-11T17:33:23.526854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:05:51.985748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1353,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.298894+0000","last_change":"2024-06-11T17:19:20.245137+0000","last_active":"2024-06-11T17:33:23.298894+0000","last_peered":"2024-06-11T17:33:23.298894+0000","last_clean":"2024-06-11T17:33:23.298894+0000","last_became_active":"2024-06-11T17:19:20.244248+0000","last_became_peered":"2024-06-11T17:19:20.244248+0000","last_unstale":"2024-06-11T17:33:23.298894+0000","last_undegraded":"2024-06-11T17:33:23.298894+0000","last_fullsized":"2024-06-11T17:33:23.298894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:59:08.798157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542328,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72484,"kb_used_data":9348,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94299356,"statfs":{"total":96636764160,"available":96562540544,"internally_reserved":0,"allocated":9572352,"data_stored":5150797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":64616906},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542330,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71952,"kb_used_data":8832,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94299888,"statfs":{"total":96636764160,"available":96563085312,"internally_reserved":0,"allocated":9043968,"data_stored":4635753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542329,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84436,"kb_used_data":8828,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94287404,"statfs":{"total":96636764160,"available":96550301696,"internally_reserved":0,"allocated":9039872,"data_stored":4621869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542330,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72040,"kb_used_data":8920,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94299800,"statfs":{"total":96636764160,"available":96562995200,"internally_reserved":0,"allocated":9134080,"data_stored":4716077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542329,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72488,"kb_used_data":9368,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94299352,"statfs":{"total":96636764160,"available":96562536448,"internally_reserved":0,"allocated":9592832,"data_stored":5176974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575032,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84440,"kb_used_data":8840,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94287400,"statfs":{"total":96636764160,"available":96550297600,"internally_reserved":0,"allocated":9052160,"data_stored":4653623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575032,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62296,"kb_used_data":8896,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94309544,"statfs":{"total":96636764160,"available":96572973056,"internally_reserved":0,"allocated":9109504,"data_stored":4701289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575034,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84512,"kb_used_data":8904,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94287328,"statfs":{"total":96636764160,"available":96550223872,"internally_reserved":0,"allocated":9117696,"data_stored":4715068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-11T17:33:26.571 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-11T17:33:26.572 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-11T17:33:26.677 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.677+0000 7fa296278640 1 Processor -- start 2024-06-11T17:33:26.678 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.677+0000 7fa296278640 1 -- start start 2024-06-11T17:33:26.679 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.677+0000 7fa296278640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa29006ddf0 0x7fa29013c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:26.679 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.677+0000 7fa296278640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa290143790 0x7fa29014d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:26.680 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.677+0000 7fa296278640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa290142ff0 con 0x7fa29006e1d0 2024-06-11T17:33:26.680 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.677+0000 7fa296278640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fa290143300 con 0x7fa29006ddf0 2024-06-11T17:33:26.680 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.677+0000 7fa296278640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fa2900aac20 con 0x7fa290143790 2024-06-11T17:33:26.680 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.681+0000 7fa28ffff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa29006ddf0 0x7fa29013c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:26.680 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.681+0000 7fa28ffff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa29006ddf0 0x7fa29013c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44108/0 (socket says 172.21.15.130:44108) 2024-06-11T17:33:26.681 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.681+0000 7fa28ffff640 1 -- 172.21.15.130:0/35033364 learned_addr learned my addr 172.21.15.130:0/35033364 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:33:26.681 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.681+0000 7fa28ffff640 1 -- 172.21.15.130:0/35033364 >> v2:172.21.15.172:3300/0 conn(0x7fa290143790 msgr2=0x7fa29014d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:33:26.681 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.681+0000 7fa294815640 1 --2- 172.21.15.130:0/35033364 >> v2:172.21.15.172:3300/0 conn(0x7fa290143790 0x7fa29014d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:26.681 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.681+0000 7fa28ffff640 1 --2- 172.21.15.130:0/35033364 >> v2:172.21.15.172:3300/0 conn(0x7fa290143790 0x7fa29014d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:26.681 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.681+0000 7fa28ffff640 1 -- 172.21.15.130:0/35033364 >> v1:172.21.15.172:6789/0 conn(0x7fa29006e1d0 legacy=0x7fa2900b3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:33:26.681 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.681+0000 7fa28ffff640 1 -- 172.21.15.130:0/35033364 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2900aba90 con 0x7fa29006ddf0 2024-06-11T17:33:26.685 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.681+0000 7fa28ffff640 1 --2- 172.21.15.130:0/35033364 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa29006ddf0 0x7fa29013c710 secure :-1 s=READY pgs=4041 cs=0 l=1 rev1=1 crypto rx=0x7fa2900ab180 tx=0x7fa28001c290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93fd4744e2b14c4a server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:26.685 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.681+0000 7fa28effd640 1 -- 172.21.15.130:0/35033364 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2800b0070 con 0x7fa29006ddf0 2024-06-11T17:33:26.686 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.681+0000 7fa28effd640 1 -- 172.21.15.130:0/35033364 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2800ab600 con 0x7fa29006ddf0 2024-06-11T17:33:26.686 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.681+0000 7fa28effd640 1 -- 172.21.15.130:0/35033364 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2800ab9d0 con 0x7fa29006ddf0 2024-06-11T17:33:26.686 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.681+0000 7fa296278640 1 -- 172.21.15.130:0/35033364 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa29006ddf0 msgr2=0x7fa29013c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:26.686 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.681+0000 7fa296278640 1 --2- 172.21.15.130:0/35033364 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa29006ddf0 0x7fa29013c710 secure :-1 s=READY pgs=4041 cs=0 l=1 rev1=1 crypto rx=0x7fa2900ab180 tx=0x7fa28001c290 comp rx=0 tx=0).stop 2024-06-11T17:33:26.686 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.681+0000 7fa296278640 1 -- 172.21.15.130:0/35033364 shutdown_connections 2024-06-11T17:33:26.686 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.681+0000 7fa296278640 1 --2- 172.21.15.130:0/35033364 >> v2:172.21.15.172:3300/0 conn(0x7fa290143790 0x7fa29014d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:26.687 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.681+0000 7fa296278640 1 --2- 172.21.15.130:0/35033364 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa29006ddf0 0x7fa29013c710 unknown :-1 s=CLOSED pgs=4041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:26.687 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.681+0000 7fa296278640 1 -- 172.21.15.130:0/35033364 >> 172.21.15.130:0/35033364 conn(0x7fa2900b8d70 msgr2=0x7fa2900b9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:26.687 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.681+0000 7fa296278640 1 -- 172.21.15.130:0/35033364 shutdown_connections 2024-06-11T17:33:26.687 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.681+0000 7fa296278640 1 -- 172.21.15.130:0/35033364 wait complete. 2024-06-11T17:33:26.687 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.685+0000 7fa296278640 1 Processor -- start 2024-06-11T17:33:26.688 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.685+0000 7fa296278640 1 -- start start 2024-06-11T17:33:26.688 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.685+0000 7fa296278640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa29006ddf0 0x7fa2900b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:26.688 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.685+0000 7fa296278640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa290143790 0x7fa2900af7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:26.688 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.685+0000 7fa296278640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2900aecd0 0x7fa2900afd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:26.688 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.685+0000 7fa296278640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa290150300 con 0x7fa29006ddf0 2024-06-11T17:33:26.688 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.685+0000 7fa296278640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa290150180 con 0x7fa2900aecd0 2024-06-11T17:33:26.688 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.685+0000 7fa296278640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa290150480 con 0x7fa290143790 2024-06-11T17:33:26.689 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.685+0000 7fa28ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa29006ddf0 0x7fa2900b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:26.689 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.685+0000 7fa28ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa29006ddf0 0x7fa2900b1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44110/0 (socket says 172.21.15.130:44110) 2024-06-11T17:33:26.689 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.685+0000 7fa28ffff640 1 -- 172.21.15.130:0/3825925165 learned_addr learned my addr 172.21.15.130:0/3825925165 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:33:26.689 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.685+0000 7fa28f7fe640 1 --2- 172.21.15.130:0/3825925165 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa290143790 0x7fa2900af7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:26.689 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.685+0000 7fa294815640 1 --2- 172.21.15.130:0/3825925165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2900aecd0 0x7fa2900afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:26.690 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.685+0000 7fa28ffff640 1 -- 172.21.15.130:0/3825925165 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa290143790 msgr2=0x7fa2900af7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:26.690 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.685+0000 7fa28ffff640 1 --2- 172.21.15.130:0/3825925165 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa290143790 0x7fa2900af7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:26.690 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.685+0000 7fa28ffff640 1 -- 172.21.15.130:0/3825925165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2900aecd0 msgr2=0x7fa2900afd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:26.690 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.685+0000 7fa28ffff640 1 --2- 172.21.15.130:0/3825925165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2900aecd0 0x7fa2900afd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:26.690 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.685+0000 7fa28ffff640 1 -- 172.21.15.130:0/3825925165 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2900ac4d0 con 0x7fa29006ddf0 2024-06-11T17:33:26.691 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.685+0000 7fa294815640 1 --2- 172.21.15.130:0/3825925165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2900aecd0 0x7fa2900afd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-11T17:33:26.691 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.685+0000 7fa28f7fe640 1 --2- 172.21.15.130:0/3825925165 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa290143790 0x7fa2900af7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:33:26.691 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.685+0000 7fa28ffff640 1 --2- 172.21.15.130:0/3825925165 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa29006ddf0 0x7fa2900b1ab0 secure :-1 s=READY pgs=4042 cs=0 l=1 rev1=1 crypto rx=0x7fa2800ae040 tx=0x7fa28001aad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:26.691 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.685+0000 7fa28cff9640 1 -- 172.21.15.130:0/3825925165 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2800ba020 con 0x7fa29006ddf0 2024-06-11T17:33:26.691 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.685+0000 7fa28cff9640 1 -- 172.21.15.130:0/3825925165 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2800b6640 con 0x7fa29006ddf0 2024-06-11T17:33:26.691 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.685+0000 7fa296278640 1 -- 172.21.15.130:0/3825925165 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2900b0d70 con 0x7fa29006ddf0 2024-06-11T17:33:26.691 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.685+0000 7fa28cff9640 1 -- 172.21.15.130:0/3825925165 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2800b0040 con 0x7fa29006ddf0 2024-06-11T17:33:26.691 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.685+0000 7fa296278640 1 -- 172.21.15.130:0/3825925165 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2900af1f0 con 0x7fa29006ddf0 2024-06-11T17:33:26.691 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.685+0000 7fa296278640 1 -- 172.21.15.130:0/3825925165 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa290076a50 con 0x7fa29006ddf0 2024-06-11T17:33:26.692 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.685+0000 7fa28cff9640 1 -- 172.21.15.130:0/3825925165 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7fa2800bd020 con 0x7fa29006ddf0 2024-06-11T17:33:26.693 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.689+0000 7fa28cff9640 1 --2- 172.21.15.130:0/3825925165 >> v2:172.21.15.130:6816/3863300924 conn(0x7fa27c070d60 0x7fa27c073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:26.693 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.689+0000 7fa28cff9640 1 -- 172.21.15.130:0/3825925165 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(702..702 src has 82..702) ==== 5253+0+0 (secure 0 0 0) 0x7fa28012b170 con 0x7fa29006ddf0 2024-06-11T17:33:26.693 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.689+0000 7fa28f7fe640 1 --2- 172.21.15.130:0/3825925165 >> v2:172.21.15.130:6816/3863300924 conn(0x7fa27c070d60 0x7fa27c073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:26.693 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.689+0000 7fa28f7fe640 1 --2- 172.21.15.130:0/3825925165 >> v2:172.21.15.130:6816/3863300924 conn(0x7fa27c070d60 0x7fa27c073220 secure :-1 s=READY pgs=3437 cs=0 l=1 rev1=1 crypto rx=0x7fa2900ade10 tx=0x7fa284007e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:26.693 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.693+0000 7fa28cff9640 1 -- 172.21.15.130:0/3825925165 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7fa2800c4030 con 0x7fa29006ddf0 2024-06-11T17:33:26.852 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.853+0000 7fa296278640 1 -- 172.21.15.130:0/3825925165 --> v2:172.21.15.130:6816/3863300924 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa290140df0 con 0x7fa27c070d60 2024-06-11T17:33:26.858 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.857+0000 7fa28cff9640 1 -- 172.21.15.130:0/3825925165 <== mgr.4107 v2:172.21.15.130:6816/3863300924 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+116183 (secure 0 0 0) 0x7fa290140df0 con 0x7fa27c070d60 2024-06-11T17:33:26.863 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:33:26.864 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2024-06-11T17:33:26.865 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.861+0000 7fa296278640 1 -- 172.21.15.130:0/3825925165 >> v2:172.21.15.130:6816/3863300924 conn(0x7fa27c070d60 msgr2=0x7fa27c073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:26.865 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.861+0000 7fa296278640 1 --2- 172.21.15.130:0/3825925165 >> v2:172.21.15.130:6816/3863300924 conn(0x7fa27c070d60 0x7fa27c073220 secure :-1 s=READY pgs=3437 cs=0 l=1 rev1=1 crypto rx=0x7fa2900ade10 tx=0x7fa284007e40 comp rx=0 tx=0).stop 2024-06-11T17:33:26.865 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.861+0000 7fa296278640 1 -- 172.21.15.130:0/3825925165 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa29006ddf0 msgr2=0x7fa2900b1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:26.865 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.861+0000 7fa296278640 1 --2- 172.21.15.130:0/3825925165 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa29006ddf0 0x7fa2900b1ab0 secure :-1 s=READY pgs=4042 cs=0 l=1 rev1=1 crypto rx=0x7fa2800ae040 tx=0x7fa28001aad0 comp rx=0 tx=0).stop 2024-06-11T17:33:26.866 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.861+0000 7fa296278640 1 -- 172.21.15.130:0/3825925165 shutdown_connections 2024-06-11T17:33:26.866 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.861+0000 7fa296278640 1 --2- 172.21.15.130:0/3825925165 >> v2:172.21.15.130:6816/3863300924 conn(0x7fa27c070d60 0x7fa27c073220 unknown :-1 s=CLOSED pgs=3437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:26.866 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.861+0000 7fa296278640 1 --2- 172.21.15.130:0/3825925165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2900aecd0 0x7fa2900afd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:26.866 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.861+0000 7fa296278640 1 --2- 172.21.15.130:0/3825925165 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa290143790 0x7fa2900af7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:26.866 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.861+0000 7fa296278640 1 --2- 172.21.15.130:0/3825925165 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa29006ddf0 0x7fa2900b1ab0 unknown :-1 s=CLOSED pgs=4042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:26.866 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.861+0000 7fa296278640 1 -- 172.21.15.130:0/3825925165 >> 172.21.15.130:0/3825925165 conn(0x7fa2900b8d70 msgr2=0x7fa2900b5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:26.866 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.861+0000 7fa296278640 1 -- 172.21.15.130:0/3825925165 shutdown_connections 2024-06-11T17:33:26.867 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:26.861+0000 7fa296278640 1 -- 172.21.15.130:0/3825925165 wait complete. 2024-06-11T17:33:26.878 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":1149,"stamp":"2024-06-11T17:33:25.309401+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590373,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":61,"num_write":108,"num_write_kb":1635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":139,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":604648,"kb_used_data":71936,"kb_used_omap":12,"kb_used_meta":532531,"kb_avail":754370072,"statfs":{"total":773094113280,"available":772474953728,"internally_reserved":0,"allocated":73662464,"data_stored":38371450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":545312306},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4000299,"num_objects":-44,"num_object_clones":-1,"num_object_copies":-132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-44,"num_whiteouts":0,"num_read":-31,"num_read_kb":-11,"num_write":-71,"num_write_kb":-3969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":-1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.038794"},"pg_stats":[{"pgid":"8.18","version":"0'0","reported_seq":1352,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.298489+0000","last_change":"2024-06-11T17:19:20.252042+0000","last_active":"2024-06-11T17:33:23.298489+0000","last_peered":"2024-06-11T17:33:23.298489+0000","last_clean":"2024-06-11T17:33:23.298489+0000","last_became_active":"2024-06-11T17:19:20.245039+0000","last_became_peered":"2024-06-11T17:19:20.245039+0000","last_unstale":"2024-06-11T17:33:23.298489+0000","last_undegraded":"2024-06-11T17:33:23.298489+0000","last_fullsized":"2024-06-11T17:33:23.298489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:37.254125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1350,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.763955+0000","last_change":"2024-06-11T17:19:20.146092+0000","last_active":"2024-06-11T17:33:23.763955+0000","last_peered":"2024-06-11T17:33:23.763955+0000","last_clean":"2024-06-11T17:33:23.763955+0000","last_became_active":"2024-06-11T17:19:20.143262+0000","last_became_peered":"2024-06-11T17:19:20.143262+0000","last_unstale":"2024-06-11T17:33:23.763955+0000","last_undegraded":"2024-06-11T17:33:23.763955+0000","last_fullsized":"2024-06-11T17:33:23.763955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:24:15.418401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1348,"reported_epoch":701,"state":"active+clean","last_fresh":"2024-06-11T17:33:24.294973+0000","last_change":"2024-06-11T17:19:20.166997+0000","last_active":"2024-06-11T17:33:24.294973+0000","last_peered":"2024-06-11T17:33:24.294973+0000","last_clean":"2024-06-11T17:33:24.294973+0000","last_became_active":"2024-06-11T17:19:20.165147+0000","last_became_peered":"2024-06-11T17:19:20.165147+0000","last_unstale":"2024-06-11T17:33:24.294973+0000","last_undegraded":"2024-06-11T17:33:24.294973+0000","last_fullsized":"2024-06-11T17:33:24.294973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:08:34.862959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1352,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.299522+0000","last_change":"2024-06-11T17:19:20.204932+0000","last_active":"2024-06-11T17:33:23.299522+0000","last_peered":"2024-06-11T17:33:23.299522+0000","last_clean":"2024-06-11T17:33:23.299522+0000","last_became_active":"2024-06-11T17:19:20.204104+0000","last_became_peered":"2024-06-11T17:19:20.204104+0000","last_unstale":"2024-06-11T17:33:23.299522+0000","last_undegraded":"2024-06-11T17:33:23.299522+0000","last_fullsized":"2024-06-11T17:33:23.299522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:22:09.289002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1350,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.764217+0000","last_change":"2024-06-11T17:19:20.142647+0000","last_active":"2024-06-11T17:33:23.764217+0000","last_peered":"2024-06-11T17:33:23.764217+0000","last_clean":"2024-06-11T17:33:23.764217+0000","last_became_active":"2024-06-11T17:19:20.141398+0000","last_became_peered":"2024-06-11T17:19:20.141398+0000","last_unstale":"2024-06-11T17:33:23.764217+0000","last_undegraded":"2024-06-11T17:33:23.764217+0000","last_fullsized":"2024-06-11T17:33:23.764217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:37:49.933084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1343,"reported_epoch":699,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.115250+0000","last_change":"2024-06-11T17:19:20.195776+0000","last_active":"2024-06-11T17:33:23.115250+0000","last_peered":"2024-06-11T17:33:23.115250+0000","last_clean":"2024-06-11T17:33:23.115250+0000","last_became_active":"2024-06-11T17:19:20.192892+0000","last_became_peered":"2024-06-11T17:19:20.192892+0000","last_unstale":"2024-06-11T17:33:23.115250+0000","last_undegraded":"2024-06-11T17:33:23.115250+0000","last_fullsized":"2024-06-11T17:33:23.115250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T05:17:41.998549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1349,"reported_epoch":701,"state":"active+clean","last_fresh":"2024-06-11T17:33:24.295279+0000","last_change":"2024-06-11T17:19:20.175472+0000","last_active":"2024-06-11T17:33:24.295279+0000","last_peered":"2024-06-11T17:33:24.295279+0000","last_clean":"2024-06-11T17:33:24.295279+0000","last_became_active":"2024-06-11T17:19:20.175221+0000","last_became_peered":"2024-06-11T17:19:20.175221+0000","last_unstale":"2024-06-11T17:33:24.295279+0000","last_undegraded":"2024-06-11T17:33:24.295279+0000","last_fullsized":"2024-06-11T17:33:24.295279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T05:05:22.352892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1343,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.295333+0000","last_change":"2024-06-11T17:19:20.121498+0000","last_active":"2024-06-11T17:33:23.295333+0000","last_peered":"2024-06-11T17:33:23.295333+0000","last_clean":"2024-06-11T17:33:23.295333+0000","last_became_active":"2024-06-11T17:19:20.120302+0000","last_became_peered":"2024-06-11T17:19:20.120302+0000","last_unstale":"2024-06-11T17:33:23.295333+0000","last_undegraded":"2024-06-11T17:33:23.295333+0000","last_fullsized":"2024-06-11T17:33:23.295333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T05:14:47.533955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1374,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.296134+0000","last_change":"2024-06-11T17:19:20.243500+0000","last_active":"2024-06-11T17:33:23.296134+0000","last_peered":"2024-06-11T17:33:23.296134+0000","last_clean":"2024-06-11T17:33:23.296134+0000","last_became_active":"2024-06-11T17:19:20.243122+0000","last_became_peered":"2024-06-11T17:19:20.243122+0000","last_unstale":"2024-06-11T17:33:23.296134+0000","last_undegraded":"2024-06-11T17:33:23.296134+0000","last_fullsized":"2024-06-11T17:33:23.296134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:11:13.381933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1","version":"19'7","reported_seq":1356,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.294858+0000","last_change":"2024-06-11T17:19:20.192244+0000","last_active":"2024-06-11T17:33:23.294858+0000","last_peered":"2024-06-11T17:33:23.294858+0000","last_clean":"2024-06-11T17:33:23.294858+0000","last_became_active":"2024-06-11T17:19:20.191981+0000","last_became_peered":"2024-06-11T17:19:20.191981+0000","last_unstale":"2024-06-11T17:33:23.294858+0000","last_undegraded":"2024-06-11T17:33:23.294858+0000","last_fullsized":"2024-06-11T17:33:23.294858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:25:30.923332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1353,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.298585+0000","last_change":"2024-06-11T17:19:20.255611+0000","last_active":"2024-06-11T17:33:23.298585+0000","last_peered":"2024-06-11T17:33:23.298585+0000","last_clean":"2024-06-11T17:33:23.298585+0000","last_became_active":"2024-06-11T17:19:20.247875+0000","last_became_peered":"2024-06-11T17:19:20.247875+0000","last_unstale":"2024-06-11T17:33:23.298585+0000","last_undegraded":"2024-06-11T17:33:23.298585+0000","last_fullsized":"2024-06-11T17:33:23.298585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:31:10.443876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1343,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.294949+0000","last_change":"2024-06-11T17:19:20.250335+0000","last_active":"2024-06-11T17:33:23.294949+0000","last_peered":"2024-06-11T17:33:23.294949+0000","last_clean":"2024-06-11T17:33:23.294949+0000","last_became_active":"2024-06-11T17:19:20.250080+0000","last_became_peered":"2024-06-11T17:19:20.250080+0000","last_unstale":"2024-06-11T17:33:23.294949+0000","last_undegraded":"2024-06-11T17:33:23.294949+0000","last_fullsized":"2024-06-11T17:33:23.294949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:14:17.864074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":1435,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.526422+0000","last_change":"2024-06-11T17:18:20.659416+0000","last_active":"2024-06-11T17:33:23.526422+0000","last_peered":"2024-06-11T17:33:23.526422+0000","last_clean":"2024-06-11T17:33:23.526422+0000","last_became_active":"2024-06-11T17:18:20.657407+0000","last_became_peered":"2024-06-11T17:18:20.657407+0000","last_unstale":"2024-06-11T17:33:23.526422+0000","last_undegraded":"2024-06-11T17:33:23.526422+0000","last_fullsized":"2024-06-11T17:33:23.526422+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:15:37.551739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1358,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.764255+0000","last_change":"2024-06-11T17:18:20.575928+0000","last_active":"2024-06-11T17:33:23.764255+0000","last_peered":"2024-06-11T17:33:23.764255+0000","last_clean":"2024-06-11T17:33:23.764255+0000","last_became_active":"2024-06-11T17:18:20.575356+0000","last_became_peered":"2024-06-11T17:18:20.575356+0000","last_unstale":"2024-06-11T17:33:23.764255+0000","last_undegraded":"2024-06-11T17:33:23.764255+0000","last_fullsized":"2024-06-11T17:33:23.764255+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:57:32.714496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1343,"reported_epoch":699,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.113179+0000","last_change":"2024-06-11T17:19:20.247282+0000","last_active":"2024-06-11T17:33:23.113179+0000","last_peered":"2024-06-11T17:33:23.113179+0000","last_clean":"2024-06-11T17:33:23.113179+0000","last_became_active":"2024-06-11T17:19:20.238515+0000","last_became_peered":"2024-06-11T17:19:20.238515+0000","last_unstale":"2024-06-11T17:33:23.113179+0000","last_undegraded":"2024-06-11T17:33:23.113179+0000","last_fullsized":"2024-06-11T17:33:23.113179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:58:29.983143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1345,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.526696+0000","last_change":"2024-06-11T17:18:20.576662+0000","last_active":"2024-06-11T17:33:23.526696+0000","last_peered":"2024-06-11T17:33:23.526696+0000","last_clean":"2024-06-11T17:33:23.526696+0000","last_became_active":"2024-06-11T17:18:20.575851+0000","last_became_peered":"2024-06-11T17:18:20.575851+0000","last_unstale":"2024-06-11T17:33:23.526696+0000","last_undegraded":"2024-06-11T17:33:23.526696+0000","last_fullsized":"2024-06-11T17:33:23.526696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:49:51.271037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1343,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.296212+0000","last_change":"2024-06-11T17:19:20.111865+0000","last_active":"2024-06-11T17:33:23.296212+0000","last_peered":"2024-06-11T17:33:23.296212+0000","last_clean":"2024-06-11T17:33:23.296212+0000","last_became_active":"2024-06-11T17:19:20.106199+0000","last_became_peered":"2024-06-11T17:19:20.106199+0000","last_unstale":"2024-06-11T17:33:23.296212+0000","last_undegraded":"2024-06-11T17:33:23.296212+0000","last_fullsized":"2024-06-11T17:33:23.296212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:03:31.736728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1364,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:24.072848+0000","last_change":"2024-06-11T17:18:20.572075+0000","last_active":"2024-06-11T17:33:24.072848+0000","last_peered":"2024-06-11T17:33:24.072848+0000","last_clean":"2024-06-11T17:33:24.072848+0000","last_became_active":"2024-06-11T17:18:20.571627+0000","last_became_peered":"2024-06-11T17:18:20.571627+0000","last_unstale":"2024-06-11T17:33:24.072848+0000","last_undegraded":"2024-06-11T17:33:24.072848+0000","last_fullsized":"2024-06-11T17:33:24.072848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:15:20.179876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1373,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.298616+0000","last_change":"2024-06-11T17:19:20.205257+0000","last_active":"2024-06-11T17:33:23.298616+0000","last_peered":"2024-06-11T17:33:23.298616+0000","last_clean":"2024-06-11T17:33:23.298616+0000","last_became_active":"2024-06-11T17:19:20.205013+0000","last_became_peered":"2024-06-11T17:19:20.205013+0000","last_unstale":"2024-06-11T17:33:23.298616+0000","last_undegraded":"2024-06-11T17:33:23.298616+0000","last_fullsized":"2024-06-11T17:33:23.298616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:28:05.365948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1358,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.763896+0000","last_change":"2024-06-11T17:18:20.576498+0000","last_active":"2024-06-11T17:33:23.763896+0000","last_peered":"2024-06-11T17:33:23.763896+0000","last_clean":"2024-06-11T17:33:23.763896+0000","last_became_active":"2024-06-11T17:18:20.575917+0000","last_became_peered":"2024-06-11T17:18:20.575917+0000","last_unstale":"2024-06-11T17:33:23.763896+0000","last_undegraded":"2024-06-11T17:33:23.763896+0000","last_fullsized":"2024-06-11T17:33:23.763896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:41:38.453105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1351,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.763714+0000","last_change":"2024-06-11T17:19:20.256793+0000","last_active":"2024-06-11T17:33:23.763714+0000","last_peered":"2024-06-11T17:33:23.763714+0000","last_clean":"2024-06-11T17:33:23.763714+0000","last_became_active":"2024-06-11T17:19:20.256125+0000","last_became_peered":"2024-06-11T17:19:20.256125+0000","last_unstale":"2024-06-11T17:33:23.763714+0000","last_undegraded":"2024-06-11T17:33:23.763714+0000","last_fullsized":"2024-06-11T17:33:23.763714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:49:16.819595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1350,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.298043+0000","last_change":"2024-06-11T17:18:20.656553+0000","last_active":"2024-06-11T17:33:23.298043+0000","last_peered":"2024-06-11T17:33:23.298043+0000","last_clean":"2024-06-11T17:33:23.298043+0000","last_became_active":"2024-06-11T17:18:20.656011+0000","last_became_peered":"2024-06-11T17:18:20.656011+0000","last_unstale":"2024-06-11T17:33:23.298043+0000","last_undegraded":"2024-06-11T17:33:23.298043+0000","last_fullsized":"2024-06-11T17:33:23.298043+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:10:47.950547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1349,"reported_epoch":701,"state":"active+clean","last_fresh":"2024-06-11T17:33:24.294965+0000","last_change":"2024-06-11T17:19:20.131816+0000","last_active":"2024-06-11T17:33:24.294965+0000","last_peered":"2024-06-11T17:33:24.294965+0000","last_clean":"2024-06-11T17:33:24.294965+0000","last_became_active":"2024-06-11T17:19:20.129276+0000","last_became_peered":"2024-06-11T17:19:20.129276+0000","last_unstale":"2024-06-11T17:33:24.294965+0000","last_undegraded":"2024-06-11T17:33:24.294965+0000","last_fullsized":"2024-06-11T17:33:24.294965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:41:04.135732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1345,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.526871+0000","last_change":"2024-06-11T17:18:20.659201+0000","last_active":"2024-06-11T17:33:23.526871+0000","last_peered":"2024-06-11T17:33:23.526871+0000","last_clean":"2024-06-11T17:33:23.526871+0000","last_became_active":"2024-06-11T17:18:20.658322+0000","last_became_peered":"2024-06-11T17:18:20.658322+0000","last_unstale":"2024-06-11T17:33:23.526871+0000","last_undegraded":"2024-06-11T17:33:23.526871+0000","last_fullsized":"2024-06-11T17:33:23.526871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T05:15:44.549344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1373,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.296005+0000","last_change":"2024-06-11T17:19:20.211466+0000","last_active":"2024-06-11T17:33:23.296005+0000","last_peered":"2024-06-11T17:33:23.296005+0000","last_clean":"2024-06-11T17:33:23.296005+0000","last_became_active":"2024-06-11T17:19:20.206654+0000","last_became_peered":"2024-06-11T17:19:20.206654+0000","last_unstale":"2024-06-11T17:33:23.296005+0000","last_undegraded":"2024-06-11T17:33:23.296005+0000","last_fullsized":"2024-06-11T17:33:23.296005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:07:31.495499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1349,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.295175+0000","last_change":"2024-06-11T17:18:20.573579+0000","last_active":"2024-06-11T17:33:23.295175+0000","last_peered":"2024-06-11T17:33:23.295175+0000","last_clean":"2024-06-11T17:33:23.295175+0000","last_became_active":"2024-06-11T17:18:20.573196+0000","last_became_peered":"2024-06-11T17:18:20.573196+0000","last_unstale":"2024-06-11T17:33:23.295175+0000","last_undegraded":"2024-06-11T17:33:23.295175+0000","last_fullsized":"2024-06-11T17:33:23.295175+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:32:09.705134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1349,"reported_epoch":701,"state":"active+clean","last_fresh":"2024-06-11T17:33:24.295365+0000","last_change":"2024-06-11T17:19:20.099973+0000","last_active":"2024-06-11T17:33:24.295365+0000","last_peered":"2024-06-11T17:33:24.295365+0000","last_clean":"2024-06-11T17:33:24.295365+0000","last_became_active":"2024-06-11T17:19:20.099516+0000","last_became_peered":"2024-06-11T17:19:20.099516+0000","last_unstale":"2024-06-11T17:33:24.295365+0000","last_undegraded":"2024-06-11T17:33:24.295365+0000","last_fullsized":"2024-06-11T17:33:24.295365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:51:48.484268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1349,"reported_epoch":699,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.116629+0000","last_change":"2024-06-11T17:18:20.575070+0000","last_active":"2024-06-11T17:33:23.116629+0000","last_peered":"2024-06-11T17:33:23.116629+0000","last_clean":"2024-06-11T17:33:23.116629+0000","last_became_active":"2024-06-11T17:18:20.574485+0000","last_became_peered":"2024-06-11T17:18:20.574485+0000","last_unstale":"2024-06-11T17:33:23.116629+0000","last_undegraded":"2024-06-11T17:33:23.116629+0000","last_fullsized":"2024-06-11T17:33:23.116629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:57.544403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1351,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.764358+0000","last_change":"2024-06-11T17:19:20.217640+0000","last_active":"2024-06-11T17:33:23.764358+0000","last_peered":"2024-06-11T17:33:23.764358+0000","last_clean":"2024-06-11T17:33:23.764358+0000","last_became_active":"2024-06-11T17:19:20.216412+0000","last_became_peered":"2024-06-11T17:19:20.216412+0000","last_unstale":"2024-06-11T17:33:23.764358+0000","last_undegraded":"2024-06-11T17:33:23.764358+0000","last_fullsized":"2024-06-11T17:33:23.764358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:37:52.624679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1349,"reported_epoch":701,"state":"active+clean","last_fresh":"2024-06-11T17:33:24.295066+0000","last_change":"2024-06-11T17:19:20.160954+0000","last_active":"2024-06-11T17:33:24.295066+0000","last_peered":"2024-06-11T17:33:24.295066+0000","last_clean":"2024-06-11T17:33:24.295066+0000","last_became_active":"2024-06-11T17:19:20.148798+0000","last_became_peered":"2024-06-11T17:19:20.148798+0000","last_unstale":"2024-06-11T17:33:24.295066+0000","last_undegraded":"2024-06-11T17:33:24.295066+0000","last_fullsized":"2024-06-11T17:33:24.295066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:14:04.308395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1374,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.297973+0000","last_change":"2024-06-11T17:19:20.127532+0000","last_active":"2024-06-11T17:33:23.297973+0000","last_peered":"2024-06-11T17:33:23.297973+0000","last_clean":"2024-06-11T17:33:23.297973+0000","last_became_active":"2024-06-11T17:19:20.125396+0000","last_became_peered":"2024-06-11T17:19:20.125396+0000","last_unstale":"2024-06-11T17:33:23.297973+0000","last_undegraded":"2024-06-11T17:33:23.297973+0000","last_fullsized":"2024-06-11T17:33:23.297973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:13:54.402896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1348,"reported_epoch":701,"state":"active+clean","last_fresh":"2024-06-11T17:33:24.294999+0000","last_change":"2024-06-11T17:19:20.227383+0000","last_active":"2024-06-11T17:33:24.294999+0000","last_peered":"2024-06-11T17:33:24.294999+0000","last_clean":"2024-06-11T17:33:24.294999+0000","last_became_active":"2024-06-11T17:19:20.226102+0000","last_became_peered":"2024-06-11T17:19:20.226102+0000","last_unstale":"2024-06-11T17:33:24.294999+0000","last_undegraded":"2024-06-11T17:33:24.294999+0000","last_fullsized":"2024-06-11T17:33:24.294999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:38:59.394056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1350,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.764217+0000","last_change":"2024-06-11T17:19:20.211934+0000","last_active":"2024-06-11T17:33:23.764217+0000","last_peered":"2024-06-11T17:33:23.764217+0000","last_clean":"2024-06-11T17:33:23.764217+0000","last_became_active":"2024-06-11T17:19:20.211650+0000","last_became_peered":"2024-06-11T17:19:20.211650+0000","last_unstale":"2024-06-11T17:33:23.764217+0000","last_undegraded":"2024-06-11T17:33:23.764217+0000","last_fullsized":"2024-06-11T17:33:23.764217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:53:48.110520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1373,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.298448+0000","last_change":"2024-06-11T17:19:20.093172+0000","last_active":"2024-06-11T17:33:23.298448+0000","last_peered":"2024-06-11T17:33:23.298448+0000","last_clean":"2024-06-11T17:33:23.298448+0000","last_became_active":"2024-06-11T17:19:20.092900+0000","last_became_peered":"2024-06-11T17:19:20.092900+0000","last_unstale":"2024-06-11T17:33:23.298448+0000","last_undegraded":"2024-06-11T17:33:23.298448+0000","last_fullsized":"2024-06-11T17:33:23.298448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:00:19.896831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1343,"reported_epoch":699,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.114919+0000","last_change":"2024-06-11T17:19:20.164400+0000","last_active":"2024-06-11T17:33:23.114919+0000","last_peered":"2024-06-11T17:33:23.114919+0000","last_clean":"2024-06-11T17:33:23.114919+0000","last_became_active":"2024-06-11T17:19:20.164153+0000","last_became_peered":"2024-06-11T17:19:20.164153+0000","last_unstale":"2024-06-11T17:33:23.114919+0000","last_undegraded":"2024-06-11T17:33:23.114919+0000","last_fullsized":"2024-06-11T17:33:23.114919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:47:00.884490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1351,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.764152+0000","last_change":"2024-06-11T17:19:20.217817+0000","last_active":"2024-06-11T17:33:23.764152+0000","last_peered":"2024-06-11T17:33:23.764152+0000","last_clean":"2024-06-11T17:33:23.764152+0000","last_became_active":"2024-06-11T17:19:20.211450+0000","last_became_peered":"2024-06-11T17:19:20.211450+0000","last_unstale":"2024-06-11T17:33:23.764152+0000","last_undegraded":"2024-06-11T17:33:23.764152+0000","last_fullsized":"2024-06-11T17:33:23.764152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:44:15.159723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1338,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.526423+0000","last_change":"2024-06-11T17:19:20.166503+0000","last_active":"2024-06-11T17:33:23.526423+0000","last_peered":"2024-06-11T17:33:23.526423+0000","last_clean":"2024-06-11T17:33:23.526423+0000","last_became_active":"2024-06-11T17:19:20.157763+0000","last_became_peered":"2024-06-11T17:19:20.157763+0000","last_unstale":"2024-06-11T17:33:23.526423+0000","last_undegraded":"2024-06-11T17:33:23.526423+0000","last_fullsized":"2024-06-11T17:33:23.526423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:07:50.951659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1337,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.526720+0000","last_change":"2024-06-11T17:19:20.180845+0000","last_active":"2024-06-11T17:33:23.526720+0000","last_peered":"2024-06-11T17:33:23.526720+0000","last_clean":"2024-06-11T17:33:23.526720+0000","last_became_active":"2024-06-11T17:19:20.180567+0000","last_became_peered":"2024-06-11T17:19:20.180567+0000","last_unstale":"2024-06-11T17:33:23.526720+0000","last_undegraded":"2024-06-11T17:33:23.526720+0000","last_fullsized":"2024-06-11T17:33:23.526720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:52:09.732771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1372,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.297822+0000","last_change":"2024-06-11T17:19:20.093495+0000","last_active":"2024-06-11T17:33:23.297822+0000","last_peered":"2024-06-11T17:33:23.297822+0000","last_clean":"2024-06-11T17:33:23.297822+0000","last_became_active":"2024-06-11T17:19:20.092534+0000","last_became_peered":"2024-06-11T17:19:20.092534+0000","last_unstale":"2024-06-11T17:33:23.297822+0000","last_undegraded":"2024-06-11T17:33:23.297822+0000","last_fullsized":"2024-06-11T17:33:23.297822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:57:08.203552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1337,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.526854+0000","last_change":"2024-06-11T17:19:20.221309+0000","last_active":"2024-06-11T17:33:23.526854+0000","last_peered":"2024-06-11T17:33:23.526854+0000","last_clean":"2024-06-11T17:33:23.526854+0000","last_became_active":"2024-06-11T17:19:20.212735+0000","last_became_peered":"2024-06-11T17:19:20.212735+0000","last_unstale":"2024-06-11T17:33:23.526854+0000","last_undegraded":"2024-06-11T17:33:23.526854+0000","last_fullsized":"2024-06-11T17:33:23.526854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:05:51.985748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1353,"reported_epoch":700,"state":"active+clean","last_fresh":"2024-06-11T17:33:23.298894+0000","last_change":"2024-06-11T17:19:20.245137+0000","last_active":"2024-06-11T17:33:23.298894+0000","last_peered":"2024-06-11T17:33:23.298894+0000","last_clean":"2024-06-11T17:33:23.298894+0000","last_became_active":"2024-06-11T17:19:20.244248+0000","last_became_peered":"2024-06-11T17:19:20.244248+0000","last_unstale":"2024-06-11T17:33:23.298894+0000","last_undegraded":"2024-06-11T17:33:23.298894+0000","last_fullsized":"2024-06-11T17:33:23.298894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:59:08.798157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542328,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72484,"kb_used_data":9348,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94299356,"statfs":{"total":96636764160,"available":96562540544,"internally_reserved":0,"allocated":9572352,"data_stored":5150797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":64616906},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542330,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71952,"kb_used_data":8832,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94299888,"statfs":{"total":96636764160,"available":96563085312,"internally_reserved":0,"allocated":9043968,"data_stored":4635753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542329,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84436,"kb_used_data":8828,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94287404,"statfs":{"total":96636764160,"available":96550301696,"internally_reserved":0,"allocated":9039872,"data_stored":4621869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542330,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72040,"kb_used_data":8920,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94299800,"statfs":{"total":96636764160,"available":96562995200,"internally_reserved":0,"allocated":9134080,"data_stored":4716077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542329,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72488,"kb_used_data":9368,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94299352,"statfs":{"total":96636764160,"available":96562536448,"internally_reserved":0,"allocated":9592832,"data_stored":5176974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575032,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84440,"kb_used_data":8840,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94287400,"statfs":{"total":96636764160,"available":96550297600,"internally_reserved":0,"allocated":9052160,"data_stored":4653623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575032,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62296,"kb_used_data":8896,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94309544,"statfs":{"total":96636764160,"available":96572973056,"internally_reserved":0,"allocated":9109504,"data_stored":4701289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575034,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84512,"kb_used_data":8904,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94287328,"statfs":{"total":96636764160,"available":96550223872,"internally_reserved":0,"allocated":9117696,"data_stored":4715068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-11T17:33:26.880 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-11T17:33:27.002 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.001+0000 7f0b6a7f8640 1 Processor -- start 2024-06-11T17:33:27.002 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.001+0000 7f0b6a7f8640 1 -- start start 2024-06-11T17:33:27.003 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.005+0000 7f0b6a7f8640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b6414a1d0 0x7f0b6414c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:27.004 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.005+0000 7f0b6a7f8640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b640aede0 con 0x7f0b640aca80 2024-06-11T17:33:27.004 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.005+0000 7f0b6a7f8640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b640ad790 con 0x7f0b64140be0 2024-06-11T17:33:27.004 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.005+0000 7f0b6a7f8640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f0b640adbe0 con 0x7f0b6414a1d0 2024-06-11T17:33:27.004 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.005+0000 7f0b63fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f0b640aca80 0x7f0b6413dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:40934/0 (socket says 172.21.15.130:40934) 2024-06-11T17:33:27.004 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.005+0000 7f0b63fff640 1 -- 172.21.15.130:0/997293372 learned_addr learned my addr 172.21.15.130:0/997293372 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-06-11T17:33:27.004 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.005+0000 7f0b68d95640 1 --2- 172.21.15.130:0/997293372 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b6414a1d0 0x7f0b6414c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:27.004 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.005+0000 7f0b62ffd640 1 -- 172.21.15.130:0/997293372 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1053118838 0 0) 0x7f0b640aede0 con 0x7f0b640aca80 2024-06-11T17:33:27.004 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.005+0000 7f0b62ffd640 1 -- 172.21.15.130:0/997293372 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b4c003530 con 0x7f0b640aca80 2024-06-11T17:33:27.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.005+0000 7f0b68d95640 1 -- 172.21.15.130:0/997293372 >> v1:172.21.15.172:6789/0 conn(0x7f0b64140be0 legacy=0x7f0b64141020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:27.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.005+0000 7f0b68d95640 1 -- 172.21.15.130:0/997293372 >> v1:172.21.15.130:6789/0 conn(0x7f0b640aca80 legacy=0x7f0b6413dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:27.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.005+0000 7f0b68d95640 1 -- 172.21.15.130:0/997293372 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b640ad240 con 0x7f0b6414a1d0 2024-06-11T17:33:27.006 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.005+0000 7f0b68d95640 1 --2- 172.21.15.130:0/997293372 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b6414a1d0 0x7f0b6414c5c0 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009dc0 tx=0x7f0b5c01c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8500a18344d70cd6 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:27.006 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.005+0000 7f0b62ffd640 1 -- 172.21.15.130:0/997293372 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c0b2070 con 0x7f0b6414a1d0 2024-06-11T17:33:27.006 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.005+0000 7f0b62ffd640 1 -- 172.21.15.130:0/997293372 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b5c0a59c0 con 0x7f0b6414a1d0 2024-06-11T17:33:27.006 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.005+0000 7f0b62ffd640 1 -- 172.21.15.130:0/997293372 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c0a5d90 con 0x7f0b6414a1d0 2024-06-11T17:33:27.007 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.009+0000 7f0b6a7f8640 1 -- 172.21.15.130:0/997293372 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b6414a1d0 msgr2=0x7f0b6414c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:27.007 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.009+0000 7f0b6a7f8640 1 --2- 172.21.15.130:0/997293372 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b6414a1d0 0x7f0b6414c5c0 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009dc0 tx=0x7f0b5c01c8e0 comp rx=0 tx=0).stop 2024-06-11T17:33:27.007 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.009+0000 7f0b6a7f8640 1 -- 172.21.15.130:0/997293372 shutdown_connections 2024-06-11T17:33:27.007 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.009+0000 7f0b6a7f8640 1 --2- 172.21.15.130:0/997293372 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b6414a1d0 0x7f0b6414c5c0 unknown :-1 s=CLOSED pgs=2307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:27.008 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.009+0000 7f0b6a7f8640 1 -- 172.21.15.130:0/997293372 >> 172.21.15.130:0/997293372 conn(0x7f0b640b46b0 msgr2=0x7f0b640b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:27.008 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.009+0000 7f0b6a7f8640 1 -- 172.21.15.130:0/997293372 shutdown_connections 2024-06-11T17:33:27.008 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.009+0000 7f0b6a7f8640 1 -- 172.21.15.130:0/997293372 wait complete. 2024-06-11T17:33:27.010 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.009+0000 7f0b6a7f8640 1 Processor -- start 2024-06-11T17:33:27.010 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.009+0000 7f0b6a7f8640 1 -- start start 2024-06-11T17:33:27.010 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.009+0000 7f0b6a7f8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b640aca80 0x7f0b64145cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:27.010 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.009+0000 7f0b6a7f8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b64140be0 0x7f0b641427c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:27.011 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.009+0000 7f0b6a7f8640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b6414a1d0 0x7f0b64146320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:27.011 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.009+0000 7f0b6a7f8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0b64073d30 con 0x7f0b640aca80 2024-06-11T17:33:27.011 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.009+0000 7f0b6a7f8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0b64073bb0 con 0x7f0b64140be0 2024-06-11T17:33:27.011 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.009+0000 7f0b6a7f8640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f0b6414f730 con 0x7f0b6414a1d0 2024-06-11T17:33:27.011 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.009+0000 7f0b63fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b640aca80 0x7f0b64145cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:27.011 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.009+0000 7f0b63fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b640aca80 0x7f0b64145cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44114/0 (socket says 172.21.15.130:44114) 2024-06-11T17:33:27.011 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.009+0000 7f0b68d95640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b6414a1d0 0x7f0b64146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:27.011 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.009+0000 7f0b63fff640 1 -- 172.21.15.130:0/2446841150 learned_addr learned my addr 172.21.15.130:0/2446841150 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:33:27.011 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.009+0000 7f0b63fff640 1 -- 172.21.15.130:0/2446841150 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b6414a1d0 msgr2=0x7f0b64146320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:27.012 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.009+0000 7f0b63fff640 1 --2- 172.21.15.130:0/2446841150 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b6414a1d0 0x7f0b64146320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:27.012 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.009+0000 7f0b63fff640 1 -- 172.21.15.130:0/2446841150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b64140be0 msgr2=0x7f0b641427c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:27.012 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.009+0000 7f0b637fe640 1 --2- 172.21.15.130:0/2446841150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b64140be0 0x7f0b641427c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:27.012 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.009+0000 7f0b63fff640 1 --2- 172.21.15.130:0/2446841150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b64140be0 0x7f0b641427c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:27.012 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.009+0000 7f0b63fff640 1 -- 172.21.15.130:0/2446841150 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b64147780 con 0x7f0b640aca80 2024-06-11T17:33:27.012 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.009+0000 7f0b68d95640 1 --2- 172.21.15.130:0/2446841150 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b6414a1d0 0x7f0b64146320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:33:27.012 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.009+0000 7f0b63fff640 1 --2- 172.21.15.130:0/2446841150 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b640aca80 0x7f0b64145cb0 secure :-1 s=READY pgs=4044 cs=0 l=1 rev1=1 crypto rx=0x7f0b5400c4d0 tx=0x7f0b5400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:27.012 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.009+0000 7f0b60ff9640 1 -- 172.21.15.130:0/2446841150 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b54017070 con 0x7f0b640aca80 2024-06-11T17:33:27.013 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.009+0000 7f0b60ff9640 1 -- 172.21.15.130:0/2446841150 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b54005cf0 con 0x7f0b640aca80 2024-06-11T17:33:27.013 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.009+0000 7f0b60ff9640 1 -- 172.21.15.130:0/2446841150 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b54007270 con 0x7f0b640aca80 2024-06-11T17:33:27.013 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.009+0000 7f0b6a7f8640 1 -- 172.21.15.130:0/2446841150 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b64147a60 con 0x7f0b640aca80 2024-06-11T17:33:27.013 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.009+0000 7f0b6a7f8640 1 -- 172.21.15.130:0/2446841150 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b64144d90 con 0x7f0b640aca80 2024-06-11T17:33:27.013 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.013+0000 7f0b6a7f8640 1 -- 172.21.15.130:0/2446841150 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b6413dd40 con 0x7f0b640aca80 2024-06-11T17:33:27.014 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.013+0000 7f0b60ff9640 1 -- 172.21.15.130:0/2446841150 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f0b5401a070 con 0x7f0b640aca80 2024-06-11T17:33:27.014 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.013+0000 7f0b60ff9640 1 --2- 172.21.15.130:0/2446841150 >> v2:172.21.15.130:6816/3863300924 conn(0x7f0b50070d60 0x7f0b50073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:27.014 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.013+0000 7f0b60ff9640 1 -- 172.21.15.130:0/2446841150 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(702..702 src has 82..702) ==== 5253+0+0 (secure 0 0 0) 0x7f0b540904b0 con 0x7f0b640aca80 2024-06-11T17:33:27.014 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.013+0000 7f0b637fe640 1 --2- 172.21.15.130:0/2446841150 >> v2:172.21.15.130:6816/3863300924 conn(0x7f0b50070d60 0x7f0b50073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:27.015 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.013+0000 7f0b637fe640 1 --2- 172.21.15.130:0/2446841150 >> v2:172.21.15.130:6816/3863300924 conn(0x7f0b50070d60 0x7f0b50073220 secure :-1 s=READY pgs=3438 cs=0 l=1 rev1=1 crypto rx=0x7f0b641461f0 tx=0x7f0b58009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:27.017 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.017+0000 7f0b60ff9640 1 -- 172.21.15.130:0/2446841150 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7f0b64147780 con 0x7f0b640aca80 2024-06-11T17:33:27.182 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.181+0000 7f0b6a7f8640 1 -- 172.21.15.130:0/2446841150 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0b6406b6a0 con 0x7f0b640aca80 2024-06-11T17:33:27.184 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.185+0000 7f0b60ff9640 1 -- 172.21.15.130:0/2446841150 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v702) ==== 74+0+15839 (secure 0 0 0) 0x7f0b5405c490 con 0x7f0b640aca80 2024-06-11T17:33:27.184 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:33:27.185 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":702,"fsid":"fae1d0b0-28f2-4ebc-8a2f-59aed9de5555","created":"2024-06-11T17:18:08.122125+0000","modified":"2024-06-11T17:33:25.300680+0000","last_up_change":"2024-06-11T17:18:18.550650+0000","last_in_change":"2024-06-11T17:18:10.336508+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":95,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":340,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-11T17:18:18.850259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-06-11T17:18:19.062089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"ceph_test_rados_api_asio","create_time":"2024-06-11T17:19:18.689387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0bb385e4-fde4-44a5-a9ca-491e3a80dd65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":697,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":1675918119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":1675918119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":1675918119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":1675918119}]},"public_addr":"172.21.15.130:6800/1675918119","cluster_addr":"172.21.15.130:6801/1675918119","heartbeat_back_addr":"172.21.15.130:6803/1675918119","heartbeat_front_addr":"172.21.15.130:6802/1675918119","state":["exists","up"]},{"osd":1,"uuid":"b96b90b9-e209-41df-9235-5ee65fc63857","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":697,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":1676407705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":1676407705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":1676407705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":1676407705}]},"public_addr":"172.21.15.130:6804/1676407705","cluster_addr":"172.21.15.130:6805/1676407705","heartbeat_back_addr":"172.21.15.130:6807/1676407705","heartbeat_front_addr":"172.21.15.130:6806/1676407705","state":["exists","up"]},{"osd":2,"uuid":"4f935459-1234-4e49-86b9-0a5963e12faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":697,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":272447947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":272447947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":272447947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":272447947}]},"public_addr":"172.21.15.130:6808/272447947","cluster_addr":"172.21.15.130:6809/272447947","heartbeat_back_addr":"172.21.15.130:6813/272447947","heartbeat_front_addr":"172.21.15.130:6811/272447947","state":["exists","up"]},{"osd":3,"uuid":"e232dcd6-4ef9-4a81-a427-bf9efcccd670","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":697,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":995804279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":995804279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":995804279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":995804279}]},"public_addr":"172.21.15.130:6810/995804279","cluster_addr":"172.21.15.130:6812/995804279","heartbeat_back_addr":"172.21.15.130:6815/995804279","heartbeat_front_addr":"172.21.15.130:6814/995804279","state":["exists","up"]},{"osd":4,"uuid":"1370f2fe-be19-41e6-8476-a59ad515bd69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":697,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":1264612709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":1264612709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6815","nonce":1264612709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":1264612709}]},"public_addr":"172.21.15.172:6812/1264612709","cluster_addr":"172.21.15.172:6813/1264612709","heartbeat_back_addr":"172.21.15.172:6815/1264612709","heartbeat_front_addr":"172.21.15.172:6814/1264612709","state":["exists","up"]},{"osd":5,"uuid":"c0e83219-1ebf-4d46-83b6-3ca844bbcfe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":697,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":63774775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":63774775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":63774775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":63774775}]},"public_addr":"172.21.15.172:6800/63774775","cluster_addr":"172.21.15.172:6802/63774775","heartbeat_back_addr":"172.21.15.172:6806/63774775","heartbeat_front_addr":"172.21.15.172:6804/63774775","state":["exists","up"]},{"osd":6,"uuid":"08334a75-d052-4cb8-ae48-5908947f920f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":697,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":1734469189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":1734469189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6811","nonce":1734469189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":1734469189}]},"public_addr":"172.21.15.172:6808/1734469189","cluster_addr":"172.21.15.172:6809/1734469189","heartbeat_back_addr":"172.21.15.172:6811/1734469189","heartbeat_front_addr":"172.21.15.172:6810/1734469189","state":["exists","up"]},{"osd":7,"uuid":"ec87f14f-b324-47e4-9740-fb304bf3d963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":697,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6801","nonce":3950047248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6803","nonce":3950047248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6807","nonce":3950047248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3950047248}]},"public_addr":"172.21.15.172:6801/3950047248","cluster_addr":"172.21.15.172:6803/3950047248","heartbeat_back_addr":"172.21.15.172:6807/3950047248","heartbeat_front_addr":"172.21.15.172:6805/3950047248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T17:18:15.782617+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T17:18:15.963078+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T17:18:15.946297+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T17:18:15.983728+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T17:18:15.867646+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T17:18:15.954321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T17:18:15.940511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T17:18:15.900797+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":12,"snaps":[{"begin":2,"length":3}]},{"pool":16,"snaps":[{"begin":5,"length":2}]},{"pool":34,"snaps":[{"begin":1,"length":1}]},{"pool":67,"snaps":[{"begin":1,"length":1}]},{"pool":94,"snaps":[{"begin":4,"length":1},{"begin":7,"length":2}]},{"pool":107,"snaps":[{"begin":1,"length":1}]},{"pool":124,"snaps":[{"begin":1,"length":2}]},{"pool":141,"snaps":[{"begin":3,"length":1}]},{"pool":144,"snaps":[{"begin":3,"length":2}]},{"pool":149,"snaps":[{"begin":2,"length":1}]},{"pool":154,"snaps":[{"begin":2,"length":2}]},{"pool":163,"snaps":[{"begin":2,"length":3}]},{"pool":168,"snaps":[{"begin":3,"length":4}]},{"pool":171,"snaps":[{"begin":4,"length":2}]},{"pool":174,"snaps":[{"begin":2,"length":2}]},{"pool":183,"snaps":[{"begin":2,"length":1}]},{"pool":188,"snaps":[{"begin":3,"length":2}]},{"pool":201,"snaps":[{"begin":4,"length":4}]},{"pool":212,"snaps":[{"begin":7,"length":1}]},{"pool":234,"snaps":[{"begin":8,"length":1}]},{"pool":244,"snaps":[{"begin":10,"length":1}]},{"pool":250,"snaps":[{"begin":11,"length":2}]},{"pool":261,"snaps":[{"begin":14,"length":1}]},{"pool":321,"snaps":[{"begin":2,"length":1}]},{"pool":322,"snaps":[{"begin":3,"length":1}]},{"pool":325,"snaps":[{"begin":4,"length":1}]},{"pool":329,"snaps":[{"begin":6,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-11T17:33:27.187 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.189+0000 7f0b6a7f8640 1 -- 172.21.15.130:0/2446841150 >> v2:172.21.15.130:6816/3863300924 conn(0x7f0b50070d60 msgr2=0x7f0b50073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:27.187 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.189+0000 7f0b6a7f8640 1 --2- 172.21.15.130:0/2446841150 >> v2:172.21.15.130:6816/3863300924 conn(0x7f0b50070d60 0x7f0b50073220 secure :-1 s=READY pgs=3438 cs=0 l=1 rev1=1 crypto rx=0x7f0b641461f0 tx=0x7f0b58009040 comp rx=0 tx=0).stop 2024-06-11T17:33:27.187 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.189+0000 7f0b6a7f8640 1 -- 172.21.15.130:0/2446841150 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b640aca80 msgr2=0x7f0b64145cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:27.187 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.189+0000 7f0b6a7f8640 1 --2- 172.21.15.130:0/2446841150 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b640aca80 0x7f0b64145cb0 secure :-1 s=READY pgs=4044 cs=0 l=1 rev1=1 crypto rx=0x7f0b5400c4d0 tx=0x7f0b5400c990 comp rx=0 tx=0).stop 2024-06-11T17:33:27.187 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.189+0000 7f0b6a7f8640 1 -- 172.21.15.130:0/2446841150 shutdown_connections 2024-06-11T17:33:27.187 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.189+0000 7f0b6a7f8640 1 --2- 172.21.15.130:0/2446841150 >> v2:172.21.15.130:6816/3863300924 conn(0x7f0b50070d60 0x7f0b50073220 unknown :-1 s=CLOSED pgs=3438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:27.187 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.189+0000 7f0b6a7f8640 1 --2- 172.21.15.130:0/2446841150 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b6414a1d0 0x7f0b64146320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:27.188 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.189+0000 7f0b6a7f8640 1 --2- 172.21.15.130:0/2446841150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b64140be0 0x7f0b641427c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:27.188 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.189+0000 7f0b6a7f8640 1 --2- 172.21.15.130:0/2446841150 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b640aca80 0x7f0b64145cb0 unknown :-1 s=CLOSED pgs=4044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:27.188 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.189+0000 7f0b6a7f8640 1 -- 172.21.15.130:0/2446841150 >> 172.21.15.130:0/2446841150 conn(0x7f0b640b46b0 msgr2=0x7f0b640b4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:27.188 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.189+0000 7f0b6a7f8640 1 -- 172.21.15.130:0/2446841150 shutdown_connections 2024-06-11T17:33:27.188 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:27.189+0000 7f0b6a7f8640 1 -- 172.21.15.130:0/2446841150 wait complete. 2024-06-11T17:33:28.204 INFO:tasks.ceph:Scrubbing osd.0 2024-06-11T17:33:28.204 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-06-11T17:33:28.341 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.341+0000 7fc1cf211640 1 Processor -- start 2024-06-11T17:33:28.341 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.341+0000 7fc1cf211640 1 -- start start 2024-06-11T17:33:28.342 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.341+0000 7fc1cf211640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc1c813ce40 0x7fc1c814b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:28.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.341+0000 7fc1cf211640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1c80ad930 con 0x7fc1c80af380 2024-06-11T17:33:28.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.345+0000 7fc1cf211640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1c80adc10 con 0x7fc1c813ffd0 2024-06-11T17:33:28.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.345+0000 7fc1cf211640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fc1c80af760 con 0x7fc1c813ce40 2024-06-11T17:33:28.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.345+0000 7fc1cd7ae640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc1c813ce40 0x7fc1c814b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:28.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.345+0000 7fc1ccfad640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fc1c80af380 0x7fc1c813f8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:60786/0 (socket says 172.21.15.130:60786) 2024-06-11T17:33:28.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.345+0000 7fc1ccfad640 1 -- 172.21.15.130:0/314696815 learned_addr learned my addr 172.21.15.130:0/314696815 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-06-11T17:33:28.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.345+0000 7fc1cd7ae640 1 -- 172.21.15.130:0/314696815 >> v1:172.21.15.172:6789/0 conn(0x7fc1c813ffd0 legacy=0x7fc1c813c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:28.344 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.345+0000 7fc1cd7ae640 1 -- 172.21.15.130:0/314696815 >> v1:172.21.15.130:6789/0 conn(0x7fc1c80af380 legacy=0x7fc1c813f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:28.344 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.345+0000 7fc1cd7ae640 1 -- 172.21.15.130:0/314696815 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c813d400 con 0x7fc1c813ce40 2024-06-11T17:33:28.345 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.345+0000 7fc1cd7ae640 1 --2- 172.21.15.130:0/314696815 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1c813ce40 0x7fc1c814b1e0 secure :-1 s=READY pgs=4046 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009d90 tx=0x7fc1c001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e436ec741588c server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:28.345 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.345+0000 7fc1bf7fe640 1 -- 172.21.15.130:0/314696815 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c00b2070 con 0x7fc1c813ce40 2024-06-11T17:33:28.345 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.345+0000 7fc1bf7fe640 1 -- 172.21.15.130:0/314696815 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1c00a5810 con 0x7fc1c813ce40 2024-06-11T17:33:28.345 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.345+0000 7fc1bf7fe640 1 -- 172.21.15.130:0/314696815 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c00a5be0 con 0x7fc1c813ce40 2024-06-11T17:33:28.346 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.345+0000 7fc1cf211640 1 -- 172.21.15.130:0/314696815 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1c813ce40 msgr2=0x7fc1c814b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:28.346 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.345+0000 7fc1cf211640 1 --2- 172.21.15.130:0/314696815 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1c813ce40 0x7fc1c814b1e0 secure :-1 s=READY pgs=4046 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009d90 tx=0x7fc1c001c950 comp rx=0 tx=0).stop 2024-06-11T17:33:28.347 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.345+0000 7fc1cf211640 1 -- 172.21.15.130:0/314696815 shutdown_connections 2024-06-11T17:33:28.347 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.345+0000 7fc1cf211640 1 --2- 172.21.15.130:0/314696815 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1c813ce40 0x7fc1c814b1e0 unknown :-1 s=CLOSED pgs=4046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:28.347 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.345+0000 7fc1cf211640 1 -- 172.21.15.130:0/314696815 >> 172.21.15.130:0/314696815 conn(0x7fc1c806cb60 msgr2=0x7fc1c80b4720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:28.347 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.345+0000 7fc1cf211640 1 -- 172.21.15.130:0/314696815 shutdown_connections 2024-06-11T17:33:28.347 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.345+0000 7fc1cf211640 1 -- 172.21.15.130:0/314696815 wait complete. 2024-06-11T17:33:28.347 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.349+0000 7fc1cf211640 1 Processor -- start 2024-06-11T17:33:28.347 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.349+0000 7fc1cf211640 1 -- start start 2024-06-11T17:33:28.349 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.349+0000 7fc1cf211640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc1c80af380 0x7fc1c81dd020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:28.349 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.349+0000 7fc1cf211640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1c813ce40 0x7fc1c813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:28.349 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.349+0000 7fc1cf211640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1c813ffd0 0x7fc1c81362b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:28.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.349+0000 7fc1cf211640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c814e2d0 con 0x7fc1c813ffd0 2024-06-11T17:33:28.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.349+0000 7fc1cf211640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c814e150 con 0x7fc1c813ce40 2024-06-11T17:33:28.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.349+0000 7fc1cf211640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc1c814e450 con 0x7fc1c80af380 2024-06-11T17:33:28.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.349+0000 7fc1ccfad640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc1c80af380 0x7fc1c81dd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:28.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.349+0000 7fc1cd7ae640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1c813ffd0 0x7fc1c81362b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:28.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.349+0000 7fc1ccfad640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc1c80af380 0x7fc1c81dd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:35096/0 (socket says 172.21.15.130:35096) 2024-06-11T17:33:28.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.349+0000 7fc1ccfad640 1 -- 172.21.15.130:0/3299008284 learned_addr learned my addr 172.21.15.130:0/3299008284 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:33:28.351 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.349+0000 7fc1bffff640 1 --2- 172.21.15.130:0/3299008284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1c813ce40 0x7fc1c813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:28.351 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.349+0000 7fc1ccfad640 1 -- 172.21.15.130:0/3299008284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1c813ce40 msgr2=0x7fc1c813bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:28.351 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.349+0000 7fc1ccfad640 1 --2- 172.21.15.130:0/3299008284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1c813ce40 0x7fc1c813bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:28.351 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.349+0000 7fc1ccfad640 1 -- 172.21.15.130:0/3299008284 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1c813ffd0 msgr2=0x7fc1c81362b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:28.351 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.349+0000 7fc1ccfad640 1 --2- 172.21.15.130:0/3299008284 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1c813ffd0 0x7fc1c81362b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:28.351 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.349+0000 7fc1ccfad640 1 -- 172.21.15.130:0/3299008284 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c813c270 con 0x7fc1c80af380 2024-06-11T17:33:28.351 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.349+0000 7fc1bffff640 1 --2- 172.21.15.130:0/3299008284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1c813ce40 0x7fc1c813bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-11T17:33:28.351 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.349+0000 7fc1cd7ae640 1 --2- 172.21.15.130:0/3299008284 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1c813ffd0 0x7fc1c81362b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:33:28.352 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.349+0000 7fc1ccfad640 1 --2- 172.21.15.130:0/3299008284 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc1c80af380 0x7fc1c81dd020 secure :-1 s=READY pgs=2308 cs=0 l=1 rev1=1 crypto rx=0x7fc1c400c4d0 tx=0x7fc1c400c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:28.352 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.349+0000 7fc1bd7fa640 1 -- 172.21.15.130:0/3299008284 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4017070 con 0x7fc1c80af380 2024-06-11T17:33:28.352 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.349+0000 7fc1bd7fa640 1 -- 172.21.15.130:0/3299008284 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1c4005cf0 con 0x7fc1c80af380 2024-06-11T17:33:28.352 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.349+0000 7fc1cf211640 1 -- 172.21.15.130:0/3299008284 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1c813b010 con 0x7fc1c80af380 2024-06-11T17:33:28.352 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.349+0000 7fc1bd7fa640 1 -- 172.21.15.130:0/3299008284 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4007270 con 0x7fc1c80af380 2024-06-11T17:33:28.352 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.349+0000 7fc1cf211640 1 -- 172.21.15.130:0/3299008284 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1c813b5d0 con 0x7fc1c80af380 2024-06-11T17:33:28.352 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.349+0000 7fc1cf211640 1 -- 172.21.15.130:0/3299008284 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc1c81dcbd0 con 0x7fc1c80af380 2024-06-11T17:33:28.353 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.349+0000 7fc1bd7fa640 1 -- 172.21.15.130:0/3299008284 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7fc1c401a070 con 0x7fc1c80af380 2024-06-11T17:33:28.354 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.349+0000 7fc1bd7fa640 1 --2- 172.21.15.130:0/3299008284 >> v2:172.21.15.130:6816/3863300924 conn(0x7fc1b4070d90 0x7fc1b4073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:28.354 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.353+0000 7fc1bffff640 1 --2- 172.21.15.130:0/3299008284 >> v2:172.21.15.130:6816/3863300924 conn(0x7fc1b4070d90 0x7fc1b4073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:28.354 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.353+0000 7fc1bd7fa640 1 -- 172.21.15.130:0/3299008284 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(702..702 src has 449..702) ==== 5253+0+0 (secure 0 0 0) 0x7fc1c4090b90 con 0x7fc1c80af380 2024-06-11T17:33:28.354 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.353+0000 7fc1bd7fa640 1 --2- 172.21.15.130:0/3299008284 >> v2:172.21.15.130:6800/1675918119 conn(0x7fc1b4078710 0x7fc1b407abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:28.354 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.353+0000 7fc1bd7fa640 1 -- 172.21.15.130:0/3299008284 --> v2:172.21.15.130:6800/1675918119 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc1c4014ec0 con 0x7fc1b4078710 2024-06-11T17:33:28.355 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.353+0000 7fc1bd7fa640 1 -- 172.21.15.130:0/3299008284 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_get_version_reply(handle=1 version=702) ==== 24+0+0 (secure 0 0 0) 0x7fc1c4091020 con 0x7fc1c80af380 2024-06-11T17:33:28.355 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.353+0000 7fc1cd7ae640 1 --2- 172.21.15.130:0/3299008284 >> v2:172.21.15.130:6800/1675918119 conn(0x7fc1b4078710 0x7fc1b407abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:28.355 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.353+0000 7fc1bffff640 1 --2- 172.21.15.130:0/3299008284 >> v2:172.21.15.130:6816/3863300924 conn(0x7fc1b4070d90 0x7fc1b4073250 secure :-1 s=READY pgs=3439 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8137ce0 tx=0x7fc1b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:28.355 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.353+0000 7fc1cd7ae640 1 --2- 172.21.15.130:0/3299008284 >> v2:172.21.15.130:6800/1675918119 conn(0x7fc1b4078710 0x7fc1b407abb0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:28.355 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.353+0000 7fc1bd7fa640 1 -- 172.21.15.130:0/3299008284 <== osd.0 v2:172.21.15.130:6800/1675918119 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc1c4014ec0 con 0x7fc1b4078710 2024-06-11T17:33:28.364 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.365+0000 7fc1cf211640 1 -- 172.21.15.130:0/3299008284 --> v2:172.21.15.130:6800/1675918119 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc1c813f8c0 con 0x7fc1b4078710 2024-06-11T17:33:28.364 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.365+0000 7fc1bd7fa640 1 -- 172.21.15.130:0/3299008284 <== osd.0 v2:172.21.15.130:6800/1675918119 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc1c813f8c0 con 0x7fc1b4078710 2024-06-11T17:33:28.365 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-06-11T17:33:28.365 INFO:teuthology.orchestra.run.smithi130.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-11T17:33:28.365 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-06-11T17:33:28.366 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.365+0000 7fc1cf211640 1 -- 172.21.15.130:0/3299008284 >> v2:172.21.15.130:6800/1675918119 conn(0x7fc1b4078710 msgr2=0x7fc1b407abb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:28.366 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.365+0000 7fc1cf211640 1 --2- 172.21.15.130:0/3299008284 >> v2:172.21.15.130:6800/1675918119 conn(0x7fc1b4078710 0x7fc1b407abb0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:28.366 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.365+0000 7fc1cf211640 1 -- 172.21.15.130:0/3299008284 >> v2:172.21.15.130:6816/3863300924 conn(0x7fc1b4070d90 msgr2=0x7fc1b4073250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:28.366 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.365+0000 7fc1cf211640 1 --2- 172.21.15.130:0/3299008284 >> v2:172.21.15.130:6816/3863300924 conn(0x7fc1b4070d90 0x7fc1b4073250 secure :-1 s=READY pgs=3439 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8137ce0 tx=0x7fc1b8009040 comp rx=0 tx=0).stop 2024-06-11T17:33:28.366 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.365+0000 7fc1cf211640 1 -- 172.21.15.130:0/3299008284 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc1c80af380 msgr2=0x7fc1c81dd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:28.367 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.365+0000 7fc1cf211640 1 --2- 172.21.15.130:0/3299008284 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc1c80af380 0x7fc1c81dd020 secure :-1 s=READY pgs=2308 cs=0 l=1 rev1=1 crypto rx=0x7fc1c400c4d0 tx=0x7fc1c400c990 comp rx=0 tx=0).stop 2024-06-11T17:33:28.367 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.365+0000 7fc1cd7ae640 1 -- 172.21.15.130:0/3299008284 reap_dead start 2024-06-11T17:33:28.367 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.365+0000 7fc1cf211640 1 -- 172.21.15.130:0/3299008284 shutdown_connections 2024-06-11T17:33:28.367 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.365+0000 7fc1cf211640 1 -- 172.21.15.130:0/3299008284 >> 172.21.15.130:0/3299008284 conn(0x7fc1c806cb60 msgr2=0x7fc1c81348b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:28.367 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.365+0000 7fc1cf211640 1 -- 172.21.15.130:0/3299008284 shutdown_connections 2024-06-11T17:33:28.367 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.365+0000 7fc1cf211640 1 -- 172.21.15.130:0/3299008284 wait complete. 2024-06-11T17:33:28.380 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-06-11T17:33:28.495 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.497+0000 7f4dc8db0640 1 Processor -- start 2024-06-11T17:33:28.495 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.497+0000 7f4dc8db0640 1 -- start start 2024-06-11T17:33:28.496 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.497+0000 7f4dc8db0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4dc4062cd0 0x7f4dc4144a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:28.496 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.497+0000 7f4dc8db0640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4dc413dbf0 0x7f4dc4140920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:28.496 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.497+0000 7f4dc8db0640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dc4144550 con 0x7f4dc4140e60 2024-06-11T17:33:28.496 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.497+0000 7f4dc8db0640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f4dc40630b0 con 0x7f4dc413dbf0 2024-06-11T17:33:28.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.497+0000 7f4dc8db0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4dc4073b10 con 0x7f4dc4062cd0 2024-06-11T17:33:28.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.497+0000 7f4dc259c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4dc4062cd0 0x7f4dc4144a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:28.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.497+0000 7f4dc1d9b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4dc413dbf0 0x7f4dc4140920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:28.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.497+0000 7f4dc2d9d640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f4dc4140e60 0x7f4dc40af800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:60792/0 (socket says 172.21.15.130:60792) 2024-06-11T17:33:28.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.497+0000 7f4dc2d9d640 1 -- 172.21.15.130:0/3026096639 learned_addr learned my addr 172.21.15.130:0/3026096639 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-06-11T17:33:28.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.497+0000 7f4dc1d9b640 1 -- 172.21.15.130:0/3026096639 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4dc4062cd0 msgr2=0x7f4dc4144a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:33:28.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.497+0000 7f4dc1d9b640 1 --2- 172.21.15.130:0/3026096639 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4dc4062cd0 0x7f4dc4144a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:28.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.497+0000 7f4dc1d9b640 1 -- 172.21.15.130:0/3026096639 >> v1:172.21.15.130:6789/0 conn(0x7f4dc4140e60 legacy=0x7f4dc40af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:28.498 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.497+0000 7f4dc1d9b640 1 -- 172.21.15.130:0/3026096639 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc40af430 con 0x7f4dc413dbf0 2024-06-11T17:33:28.507 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.501+0000 7f4dc1d9b640 1 --2- 172.21.15.130:0/3026096639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4dc413dbf0 0x7f4dc4140920 secure :-1 s=READY pgs=4048 cs=0 l=1 rev1=1 crypto rx=0x7f4db80097c0 tx=0x7f4db801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76e1e6ad765938d7 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:28.507 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.501+0000 7f4dc159a640 1 -- 172.21.15.130:0/3026096639 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db80b0070 con 0x7f4dc413dbf0 2024-06-11T17:33:28.507 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.501+0000 7f4dc159a640 1 -- 172.21.15.130:0/3026096639 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db80ab600 con 0x7f4dc413dbf0 2024-06-11T17:33:28.507 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.501+0000 7f4dc159a640 1 -- 172.21.15.130:0/3026096639 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db80ab9d0 con 0x7f4dc413dbf0 2024-06-11T17:33:28.507 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.501+0000 7f4dc8db0640 1 -- 172.21.15.130:0/3026096639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4dc413dbf0 msgr2=0x7f4dc4140920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:28.508 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.501+0000 7f4dc8db0640 1 --2- 172.21.15.130:0/3026096639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4dc413dbf0 0x7f4dc4140920 secure :-1 s=READY pgs=4048 cs=0 l=1 rev1=1 crypto rx=0x7f4db80097c0 tx=0x7f4db801c360 comp rx=0 tx=0).stop 2024-06-11T17:33:28.508 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.501+0000 7f4dc8db0640 1 -- 172.21.15.130:0/3026096639 shutdown_connections 2024-06-11T17:33:28.508 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.501+0000 7f4dc8db0640 1 --2- 172.21.15.130:0/3026096639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4dc413dbf0 0x7f4dc4140920 unknown :-1 s=CLOSED pgs=4048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:28.508 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.501+0000 7f4dc8db0640 1 --2- 172.21.15.130:0/3026096639 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4dc4062cd0 0x7f4dc4144a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:28.508 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.501+0000 7f4dc8db0640 1 -- 172.21.15.130:0/3026096639 >> 172.21.15.130:0/3026096639 conn(0x7f4dc40b4e00 msgr2=0x7f4dc40b5210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:28.508 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.501+0000 7f4dc8db0640 1 -- 172.21.15.130:0/3026096639 shutdown_connections 2024-06-11T17:33:28.509 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.501+0000 7f4dc8db0640 1 -- 172.21.15.130:0/3026096639 wait complete. 2024-06-11T17:33:28.509 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.501+0000 7f4dc8db0640 1 Processor -- start 2024-06-11T17:33:28.509 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.501+0000 7f4dc8db0640 1 -- start start 2024-06-11T17:33:28.509 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.501+0000 7f4dc8db0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4dc4062cd0 0x7f4dc406f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:28.509 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.501+0000 7f4dc8db0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4dc4140e60 0x7f4dc41defa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:28.509 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.501+0000 7f4dc8db0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dc41df4e0 0x7f4dc413cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:28.510 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.501+0000 7f4dc8db0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc414e460 con 0x7f4dc4140e60 2024-06-11T17:33:28.510 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.501+0000 7f4dc8db0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc4072af0 con 0x7f4dc41df4e0 2024-06-11T17:33:28.510 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.501+0000 7f4dc8db0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4dc414e5e0 con 0x7f4dc4062cd0 2024-06-11T17:33:28.510 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.501+0000 7f4dc259c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4dc4062cd0 0x7f4dc406f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:28.511 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.501+0000 7f4dc1d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4dc4140e60 0x7f4dc41defa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:28.511 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.501+0000 7f4dc259c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4dc4062cd0 0x7f4dc406f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:35110/0 (socket says 172.21.15.130:35110) 2024-06-11T17:33:28.511 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.501+0000 7f4dc1d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4dc4140e60 0x7f4dc41defa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54962/0 (socket says 172.21.15.130:54962) 2024-06-11T17:33:28.512 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.501+0000 7f4dc259c640 1 -- 172.21.15.130:0/845446080 learned_addr learned my addr 172.21.15.130:0/845446080 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:33:28.512 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.505+0000 7f4dc2d9d640 1 --2- 172.21.15.130:0/845446080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dc41df4e0 0x7f4dc413cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:28.513 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.505+0000 7f4dc259c640 1 -- 172.21.15.130:0/845446080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dc41df4e0 msgr2=0x7f4dc413cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:28.514 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.505+0000 7f4dc259c640 1 --2- 172.21.15.130:0/845446080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dc41df4e0 0x7f4dc413cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:28.514 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.505+0000 7f4dc259c640 1 -- 172.21.15.130:0/845446080 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4dc4140e60 msgr2=0x7f4dc41defa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:28.515 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.505+0000 7f4dc259c640 1 --2- 172.21.15.130:0/845446080 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4dc4140e60 0x7f4dc41defa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:28.515 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.505+0000 7f4dc259c640 1 -- 172.21.15.130:0/845446080 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc40711d0 con 0x7f4dc4062cd0 2024-06-11T17:33:28.516 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.505+0000 7f4dc1d9b640 1 --2- 172.21.15.130:0/845446080 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4dc4140e60 0x7f4dc41defa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:33:28.517 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.505+0000 7f4dc259c640 1 --2- 172.21.15.130:0/845446080 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4dc4062cd0 0x7f4dc406f680 secure :-1 s=READY pgs=2309 cs=0 l=1 rev1=1 crypto rx=0x7f4db400e960 tx=0x7f4db400ee20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:28.517 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.505+0000 7f4db2ffd640 1 -- 172.21.15.130:0/845446080 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db4017070 con 0x7f4dc4062cd0 2024-06-11T17:33:28.517 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.505+0000 7f4db2ffd640 1 -- 172.21.15.130:0/845446080 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db400c9a0 con 0x7f4dc4062cd0 2024-06-11T17:33:28.517 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.505+0000 7f4dc8db0640 1 -- 172.21.15.130:0/845446080 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dc406fc60 con 0x7f4dc4062cd0 2024-06-11T17:33:28.518 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.505+0000 7f4db2ffd640 1 -- 172.21.15.130:0/845446080 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db400cd50 con 0x7f4dc4062cd0 2024-06-11T17:33:28.518 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.505+0000 7f4dc8db0640 1 -- 172.21.15.130:0/845446080 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dc4070460 con 0x7f4dc4062cd0 2024-06-11T17:33:28.519 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.505+0000 7f4dc8db0640 1 -- 172.21.15.130:0/845446080 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dc4140920 con 0x7f4dc4062cd0 2024-06-11T17:33:28.519 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.505+0000 7f4db2ffd640 1 -- 172.21.15.130:0/845446080 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f4db401a070 con 0x7f4dc4062cd0 2024-06-11T17:33:28.519 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.505+0000 7f4db2ffd640 1 --2- 172.21.15.130:0/845446080 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4da4070d60 0x7f4da4073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:28.519 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.505+0000 7f4dc1d9b640 1 --2- 172.21.15.130:0/845446080 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4da4070d60 0x7f4da4073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:28.519 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.505+0000 7f4db2ffd640 1 -- 172.21.15.130:0/845446080 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(702..702 src has 449..702) ==== 5253+0+0 (secure 0 0 0) 0x7f4db40910e0 con 0x7f4dc4062cd0 2024-06-11T17:33:28.520 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.505+0000 7f4dc1d9b640 1 --2- 172.21.15.130:0/845446080 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4da4070d60 0x7f4da4073220 secure :-1 s=READY pgs=3440 cs=0 l=1 rev1=1 crypto rx=0x7f4db80ad000 tx=0x7f4db8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:28.522 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.509+0000 7f4db2ffd640 1 -- 172.21.15.130:0/845446080 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7f4db405cfe0 con 0x7f4dc4062cd0 2024-06-11T17:33:28.668 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.665+0000 7f4dc8db0640 1 -- 172.21.15.130:0/845446080 --> v2:172.21.15.130:6816/3863300924 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f4dc4069650 con 0x7f4da4070d60 2024-06-11T17:33:28.669 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.665+0000 7f4db2ffd640 1 -- 172.21.15.130:0/845446080 <== mgr.4107 v2:172.21.15.130:6816/3863300924 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4dc4069650 con 0x7f4da4070d60 2024-06-11T17:33:28.670 INFO:teuthology.orchestra.run.smithi130.stderr:instructed osd(s) 0 to deep-scrub 2024-06-11T17:33:28.670 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.665+0000 7f4dc8db0640 1 -- 172.21.15.130:0/845446080 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4da4070d60 msgr2=0x7f4da4073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:28.672 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.665+0000 7f4dc8db0640 1 --2- 172.21.15.130:0/845446080 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4da4070d60 0x7f4da4073220 secure :-1 s=READY pgs=3440 cs=0 l=1 rev1=1 crypto rx=0x7f4db80ad000 tx=0x7f4db8008040 comp rx=0 tx=0).stop 2024-06-11T17:33:28.674 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.665+0000 7f4dc8db0640 1 -- 172.21.15.130:0/845446080 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4dc4062cd0 msgr2=0x7f4dc406f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:28.674 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.665+0000 7f4dc8db0640 1 --2- 172.21.15.130:0/845446080 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4dc4062cd0 0x7f4dc406f680 secure :-1 s=READY pgs=2309 cs=0 l=1 rev1=1 crypto rx=0x7f4db400e960 tx=0x7f4db400ee20 comp rx=0 tx=0).stop 2024-06-11T17:33:28.675 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.665+0000 7f4dc8db0640 1 -- 172.21.15.130:0/845446080 shutdown_connections 2024-06-11T17:33:28.676 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.665+0000 7f4dc8db0640 1 --2- 172.21.15.130:0/845446080 >> v2:172.21.15.130:6816/3863300924 conn(0x7f4da4070d60 0x7f4da4073220 unknown :-1 s=CLOSED pgs=3440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:28.676 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.665+0000 7f4dc8db0640 1 --2- 172.21.15.130:0/845446080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dc41df4e0 0x7f4dc413cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:28.677 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.665+0000 7f4dc8db0640 1 --2- 172.21.15.130:0/845446080 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4dc4140e60 0x7f4dc41defa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:28.677 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.665+0000 7f4dc8db0640 1 --2- 172.21.15.130:0/845446080 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4dc4062cd0 0x7f4dc406f680 unknown :-1 s=CLOSED pgs=2309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:28.677 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.665+0000 7f4dc8db0640 1 -- 172.21.15.130:0/845446080 >> 172.21.15.130:0/845446080 conn(0x7f4dc40b4e00 msgr2=0x7f4dc40b21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:28.678 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.665+0000 7f4dc8db0640 1 -- 172.21.15.130:0/845446080 shutdown_connections 2024-06-11T17:33:28.678 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.665+0000 7f4dc8db0640 1 -- 172.21.15.130:0/845446080 wait complete. 2024-06-11T17:33:28.682 INFO:tasks.ceph:Scrubbing osd.1 2024-06-11T17:33:28.683 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-06-11T17:33:28.808 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.809+0000 7ff16976e640 1 Processor -- start 2024-06-11T17:33:28.808 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.809+0000 7ff16976e640 1 -- start start 2024-06-11T17:33:28.809 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.809+0000 7ff16976e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff16413fd30 0x7ff164140180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:28.809 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.809+0000 7ff16976e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff164142b40 0x7ff164142f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:28.810 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.809+0000 7ff16976e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1640af800 con 0x7ff1640aff10 2024-06-11T17:33:28.810 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.809+0000 7ff16976e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7ff1640745c0 con 0x7ff164142b40 2024-06-11T17:33:28.810 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.809+0000 7ff16976e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7ff1640740a0 con 0x7ff16413fd30 2024-06-11T17:33:28.810 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.809+0000 7ff162ffd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7ff1640aff10 0x7ff1640b02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:60800/0 (socket says 172.21.15.130:60800) 2024-06-11T17:33:28.810 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.809+0000 7ff162ffd640 1 -- 172.21.15.130:0/1019196236 learned_addr learned my addr 172.21.15.130:0/1019196236 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-06-11T17:33:28.810 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.809+0000 7ff1637fe640 1 --2- 172.21.15.130:0/1019196236 >> v2:172.21.15.130:3300/0 conn(0x7ff164142b40 0x7ff164142f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:28.811 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.809+0000 7ff1627fc640 1 --2- 172.21.15.130:0/1019196236 >> v2:172.21.15.172:3300/0 conn(0x7ff16413fd30 0x7ff164140180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:28.811 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.809+0000 7ff161ffb640 1 -- 172.21.15.130:0/1019196236 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3244350313 0 0) 0x7ff1640af800 con 0x7ff1640aff10 2024-06-11T17:33:28.811 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.809+0000 7ff161ffb640 1 -- 172.21.15.130:0/1019196236 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff14c003530 con 0x7ff1640aff10 2024-06-11T17:33:28.811 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.809+0000 7ff1637fe640 1 -- 172.21.15.130:0/1019196236 >> v2:172.21.15.172:3300/0 conn(0x7ff16413fd30 msgr2=0x7ff164140180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:33:28.811 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.809+0000 7ff1637fe640 1 --2- 172.21.15.130:0/1019196236 >> v2:172.21.15.172:3300/0 conn(0x7ff16413fd30 0x7ff164140180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:28.811 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.809+0000 7ff1637fe640 1 -- 172.21.15.130:0/1019196236 >> v1:172.21.15.130:6789/0 conn(0x7ff1640aff10 legacy=0x7ff1640b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:28.811 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.809+0000 7ff1637fe640 1 -- 172.21.15.130:0/1019196236 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1641406c0 con 0x7ff164142b40 2024-06-11T17:33:28.812 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.813+0000 7ff1637fe640 1 --2- 172.21.15.130:0/1019196236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff164142b40 0x7ff164142f70 secure :-1 s=READY pgs=4050 cs=0 l=1 rev1=1 crypto rx=0x7ff1640af080 tx=0x7ff15c01c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9923363ac8f046ae server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:28.812 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.813+0000 7ff161ffb640 1 -- 172.21.15.130:0/1019196236 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff15c0a66c0 con 0x7ff164142b40 2024-06-11T17:33:28.813 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.813+0000 7ff161ffb640 1 -- 172.21.15.130:0/1019196236 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff15c0a6860 con 0x7ff164142b40 2024-06-11T17:33:28.813 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.813+0000 7ff161ffb640 1 -- 172.21.15.130:0/1019196236 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff15c0a6c30 con 0x7ff164142b40 2024-06-11T17:33:28.813 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.813+0000 7ff16976e640 1 -- 172.21.15.130:0/1019196236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff164142b40 msgr2=0x7ff164142f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:28.813 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.813+0000 7ff16976e640 1 --2- 172.21.15.130:0/1019196236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff164142b40 0x7ff164142f70 secure :-1 s=READY pgs=4050 cs=0 l=1 rev1=1 crypto rx=0x7ff1640af080 tx=0x7ff15c01c7f0 comp rx=0 tx=0).stop 2024-06-11T17:33:28.813 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.813+0000 7ff16976e640 1 -- 172.21.15.130:0/1019196236 shutdown_connections 2024-06-11T17:33:28.813 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.813+0000 7ff16976e640 1 --2- 172.21.15.130:0/1019196236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff164142b40 0x7ff164142f70 unknown :-1 s=CLOSED pgs=4050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:28.813 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.813+0000 7ff16976e640 1 --2- 172.21.15.130:0/1019196236 >> v2:172.21.15.172:3300/0 conn(0x7ff16413fd30 0x7ff164140180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:28.813 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.813+0000 7ff16976e640 1 -- 172.21.15.130:0/1019196236 >> 172.21.15.130:0/1019196236 conn(0x7ff1640b6c50 msgr2=0x7ff1640b7060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:28.814 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.813+0000 7ff16976e640 1 -- 172.21.15.130:0/1019196236 shutdown_connections 2024-06-11T17:33:28.814 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.813+0000 7ff16976e640 1 -- 172.21.15.130:0/1019196236 wait complete. 2024-06-11T17:33:28.817 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.813+0000 7ff16976e640 1 Processor -- start 2024-06-11T17:33:28.817 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.813+0000 7ff16976e640 1 -- start start 2024-06-11T17:33:28.817 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.813+0000 7ff16976e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1640aff10 0x7ff164073510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:28.817 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.813+0000 7ff16976e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff16413fd30 0x7ff164145d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:28.817 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.813+0000 7ff16976e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff164142b40 0x7ff1641462c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:28.818 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.813+0000 7ff16976e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff16414ff40 con 0x7ff1640aff10 2024-06-11T17:33:28.818 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.813+0000 7ff16976e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff16414fdc0 con 0x7ff164142b40 2024-06-11T17:33:28.818 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.813+0000 7ff16976e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff1641500c0 con 0x7ff16413fd30 2024-06-11T17:33:28.818 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.813+0000 7ff162ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1640aff10 0x7ff164073510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:28.818 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.813+0000 7ff1627fc640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff16413fd30 0x7ff164145d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:28.818 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.813+0000 7ff1627fc640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff16413fd30 0x7ff164145d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:35116/0 (socket says 172.21.15.130:35116) 2024-06-11T17:33:28.818 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.813+0000 7ff162ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1640aff10 0x7ff164073510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54970/0 (socket says 172.21.15.130:54970) 2024-06-11T17:33:28.819 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.813+0000 7ff1627fc640 1 -- 172.21.15.130:0/1560558984 learned_addr learned my addr 172.21.15.130:0/1560558984 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:33:28.819 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.813+0000 7ff1637fe640 1 --2- 172.21.15.130:0/1560558984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff164142b40 0x7ff1641462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:28.819 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.813+0000 7ff1627fc640 1 -- 172.21.15.130:0/1560558984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff164142b40 msgr2=0x7ff1641462c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:28.819 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.817+0000 7ff1627fc640 1 --2- 172.21.15.130:0/1560558984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff164142b40 0x7ff1641462c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:28.819 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.817+0000 7ff1627fc640 1 -- 172.21.15.130:0/1560558984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1640aff10 msgr2=0x7ff164073510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:28.819 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.817+0000 7ff1627fc640 1 --2- 172.21.15.130:0/1560558984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1640aff10 0x7ff164073510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:28.819 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.817+0000 7ff1627fc640 1 -- 172.21.15.130:0/1560558984 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff16414c1c0 con 0x7ff16413fd30 2024-06-11T17:33:28.819 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.817+0000 7ff162ffd640 1 --2- 172.21.15.130:0/1560558984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1640aff10 0x7ff164073510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:33:28.819 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.817+0000 7ff1637fe640 1 --2- 172.21.15.130:0/1560558984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff164142b40 0x7ff1641462c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-11T17:33:28.820 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.817+0000 7ff1627fc640 1 --2- 172.21.15.130:0/1560558984 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff16413fd30 0x7ff164145d80 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 crypto rx=0x7ff15800e930 tx=0x7ff15800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:28.820 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.817+0000 7ff14b7fe640 1 -- 172.21.15.130:0/1560558984 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff158017070 con 0x7ff16413fd30 2024-06-11T17:33:28.820 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.817+0000 7ff14b7fe640 1 -- 172.21.15.130:0/1560558984 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff15800ca00 con 0x7ff16413fd30 2024-06-11T17:33:28.820 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.817+0000 7ff16976e640 1 -- 172.21.15.130:0/1560558984 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff16414beb0 con 0x7ff16413fd30 2024-06-11T17:33:28.820 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.817+0000 7ff14b7fe640 1 -- 172.21.15.130:0/1560558984 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff15800cdb0 con 0x7ff16413fd30 2024-06-11T17:33:28.820 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.817+0000 7ff16976e640 1 -- 172.21.15.130:0/1560558984 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff164147150 con 0x7ff16413fd30 2024-06-11T17:33:28.820 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.817+0000 7ff16976e640 1 -- 172.21.15.130:0/1560558984 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff164140180 con 0x7ff16413fd30 2024-06-11T17:33:28.820 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.817+0000 7ff14b7fe640 1 -- 172.21.15.130:0/1560558984 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7ff15801a070 con 0x7ff16413fd30 2024-06-11T17:33:28.821 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.817+0000 7ff14b7fe640 1 --2- 172.21.15.130:0/1560558984 >> v2:172.21.15.130:6816/3863300924 conn(0x7ff150070d60 0x7ff150073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:28.821 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.817+0000 7ff14b7fe640 1 -- 172.21.15.130:0/1560558984 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(702..702 src has 449..702) ==== 5253+0+0 (secure 0 0 0) 0x7ff158091170 con 0x7ff16413fd30 2024-06-11T17:33:28.821 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.817+0000 7ff162ffd640 1 --2- 172.21.15.130:0/1560558984 >> v2:172.21.15.130:6816/3863300924 conn(0x7ff150070d60 0x7ff150073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:28.821 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.817+0000 7ff14b7fe640 1 --2- 172.21.15.130:0/1560558984 >> v2:172.21.15.130:6804/1676407705 conn(0x7ff150078680 0x7ff15007ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:28.821 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.817+0000 7ff14b7fe640 1 -- 172.21.15.130:0/1560558984 --> v2:172.21.15.130:6804/1676407705 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff15007b1b0 con 0x7ff150078680 2024-06-11T17:33:28.821 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.817+0000 7ff14b7fe640 1 -- 172.21.15.130:0/1560558984 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_get_version_reply(handle=1 version=702) ==== 24+0+0 (secure 0 0 0) 0x7ff158091600 con 0x7ff16413fd30 2024-06-11T17:33:28.821 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.817+0000 7ff1637fe640 1 --2- 172.21.15.130:0/1560558984 >> v2:172.21.15.130:6804/1676407705 conn(0x7ff150078680 0x7ff15007ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:28.821 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.817+0000 7ff162ffd640 1 --2- 172.21.15.130:0/1560558984 >> v2:172.21.15.130:6816/3863300924 conn(0x7ff150070d60 0x7ff150073220 secure :-1 s=READY pgs=3441 cs=0 l=1 rev1=1 crypto rx=0x7ff154007fd0 tx=0x7ff1540079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:28.822 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.817+0000 7ff1637fe640 1 --2- 172.21.15.130:0/1560558984 >> v2:172.21.15.130:6804/1676407705 conn(0x7ff150078680 0x7ff15007ab20 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:28.822 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.817+0000 7ff14b7fe640 1 -- 172.21.15.130:0/1560558984 <== osd.1 v2:172.21.15.130:6804/1676407705 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff15007b1b0 con 0x7ff150078680 2024-06-11T17:33:28.830 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.833+0000 7ff16976e640 1 -- 172.21.15.130:0/1560558984 --> v2:172.21.15.130:6804/1676407705 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff164146dd0 con 0x7ff150078680 2024-06-11T17:33:28.830 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.833+0000 7ff14b7fe640 1 -- 172.21.15.130:0/1560558984 <== osd.1 v2:172.21.15.130:6804/1676407705 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff164146dd0 con 0x7ff150078680 2024-06-11T17:33:28.831 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-06-11T17:33:28.831 INFO:teuthology.orchestra.run.smithi130.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-11T17:33:28.831 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-06-11T17:33:28.832 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.833+0000 7ff16976e640 1 -- 172.21.15.130:0/1560558984 >> v2:172.21.15.130:6804/1676407705 conn(0x7ff150078680 msgr2=0x7ff15007ab20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:28.832 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.833+0000 7ff16976e640 1 --2- 172.21.15.130:0/1560558984 >> v2:172.21.15.130:6804/1676407705 conn(0x7ff150078680 0x7ff15007ab20 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:28.832 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.833+0000 7ff16976e640 1 -- 172.21.15.130:0/1560558984 >> v2:172.21.15.130:6816/3863300924 conn(0x7ff150070d60 msgr2=0x7ff150073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:28.832 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.833+0000 7ff16976e640 1 --2- 172.21.15.130:0/1560558984 >> v2:172.21.15.130:6816/3863300924 conn(0x7ff150070d60 0x7ff150073220 secure :-1 s=READY pgs=3441 cs=0 l=1 rev1=1 crypto rx=0x7ff154007fd0 tx=0x7ff1540079c0 comp rx=0 tx=0).stop 2024-06-11T17:33:28.833 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.833+0000 7ff16976e640 1 -- 172.21.15.130:0/1560558984 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff16413fd30 msgr2=0x7ff164145d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:28.833 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.833+0000 7ff16976e640 1 --2- 172.21.15.130:0/1560558984 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff16413fd30 0x7ff164145d80 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 crypto rx=0x7ff15800e930 tx=0x7ff15800edf0 comp rx=0 tx=0).stop 2024-06-11T17:33:28.833 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.833+0000 7ff1637fe640 1 -- 172.21.15.130:0/1560558984 reap_dead start 2024-06-11T17:33:28.833 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.833+0000 7ff16976e640 1 -- 172.21.15.130:0/1560558984 shutdown_connections 2024-06-11T17:33:28.833 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.833+0000 7ff16976e640 1 -- 172.21.15.130:0/1560558984 >> 172.21.15.130:0/1560558984 conn(0x7ff1640b6c50 msgr2=0x7ff1640b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:28.833 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.833+0000 7ff16976e640 1 -- 172.21.15.130:0/1560558984 shutdown_connections 2024-06-11T17:33:28.833 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.833+0000 7ff16976e640 1 -- 172.21.15.130:0/1560558984 wait complete. 2024-06-11T17:33:28.846 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-06-11T17:33:28.951 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.953+0000 7f08ac839640 1 Processor -- start 2024-06-11T17:33:28.951 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.953+0000 7f08ac839640 1 -- start start 2024-06-11T17:33:28.952 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.953+0000 7f08ac839640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08a80aca80 0x7f08a813dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:28.952 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.953+0000 7f08ac839640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f08a813e280 0x7f08a8140be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:28.953 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.953+0000 7f08ac839640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08a80aede0 con 0x7f08a8141120 2024-06-11T17:33:28.953 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.953+0000 7f08ac839640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f08a80ad790 con 0x7f08a813e280 2024-06-11T17:33:28.953 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.953+0000 7f08ac839640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f08a80adbe0 con 0x7f08a80aca80 2024-06-11T17:33:28.953 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.953+0000 7f08a659c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08a80aca80 0x7f08a813dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:28.953 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.953+0000 7f08a659c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08a80aca80 0x7f08a813dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:35130/0 (socket says 172.21.15.130:35130) 2024-06-11T17:33:28.953 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.953+0000 7f08a659c640 1 -- 172.21.15.130:0/2196239132 learned_addr learned my addr 172.21.15.130:0/2196239132 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:33:28.953 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.953+0000 7f08a5d9b640 1 --2- 172.21.15.130:0/2196239132 >> v2:172.21.15.172:3300/0 conn(0x7f08a813e280 0x7f08a8140be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:28.953 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.953+0000 7f08a659c640 1 -- 172.21.15.130:0/2196239132 >> v2:172.21.15.172:3300/0 conn(0x7f08a813e280 msgr2=0x7f08a8140be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:33:28.954 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.953+0000 7f08a659c640 1 --2- 172.21.15.130:0/2196239132 >> v2:172.21.15.172:3300/0 conn(0x7f08a813e280 0x7f08a8140be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:28.954 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.953+0000 7f08a659c640 1 -- 172.21.15.130:0/2196239132 >> v1:172.21.15.172:6789/0 conn(0x7f08a8141120 legacy=0x7f08a8143ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:28.954 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.953+0000 7f08a659c640 1 -- 172.21.15.130:0/2196239132 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a80ad240 con 0x7f08a80aca80 2024-06-11T17:33:28.955 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f08a659c640 1 --2- 172.21.15.130:0/2196239132 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08a80aca80 0x7f08a813dd40 secure :-1 s=READY pgs=2311 cs=0 l=1 rev1=1 crypto rx=0x7f0898009e50 tx=0x7f089801c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23856b5d8a828943 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:28.955 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f08a559a640 1 -- 172.21.15.130:0/2196239132 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08980a5750 con 0x7f08a80aca80 2024-06-11T17:33:28.955 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f08a559a640 1 -- 172.21.15.130:0/2196239132 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08980a58f0 con 0x7f08a80aca80 2024-06-11T17:33:28.955 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f08a559a640 1 -- 172.21.15.130:0/2196239132 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08980a5cc0 con 0x7f08a80aca80 2024-06-11T17:33:28.955 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f08ac839640 1 -- 172.21.15.130:0/2196239132 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08a80aca80 msgr2=0x7f08a813dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:28.955 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f08ac839640 1 --2- 172.21.15.130:0/2196239132 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08a80aca80 0x7f08a813dd40 secure :-1 s=READY pgs=2311 cs=0 l=1 rev1=1 crypto rx=0x7f0898009e50 tx=0x7f089801c980 comp rx=0 tx=0).stop 2024-06-11T17:33:28.956 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f08ac839640 1 -- 172.21.15.130:0/2196239132 shutdown_connections 2024-06-11T17:33:28.956 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f08ac839640 1 --2- 172.21.15.130:0/2196239132 >> v2:172.21.15.172:3300/0 conn(0x7f08a813e280 0x7f08a8140be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:28.956 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f08ac839640 1 --2- 172.21.15.130:0/2196239132 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08a80aca80 0x7f08a813dd40 unknown :-1 s=CLOSED pgs=2311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:28.956 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f08ac839640 1 -- 172.21.15.130:0/2196239132 >> 172.21.15.130:0/2196239132 conn(0x7f08a80b46b0 msgr2=0x7f08a80b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:28.956 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f08ac839640 1 -- 172.21.15.130:0/2196239132 shutdown_connections 2024-06-11T17:33:28.956 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f08ac839640 1 -- 172.21.15.130:0/2196239132 wait complete. 2024-06-11T17:33:28.958 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f08ac839640 1 Processor -- start 2024-06-11T17:33:28.958 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f08ac839640 1 -- start start 2024-06-11T17:33:28.958 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f08ac839640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08a80aca80 0x7f08a81dce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:28.959 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f08ac839640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08a813e280 0x7f08a8144f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:28.959 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f08ac839640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08a8141120 0x7f08a81454d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:28.959 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f08ac839640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f08a814e400 con 0x7f08a813e280 2024-06-11T17:33:28.959 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f08ac839640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f08a8073dc0 con 0x7f08a80aca80 2024-06-11T17:33:28.959 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f08ac839640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f08a814e580 con 0x7f08a8141120 2024-06-11T17:33:28.959 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f08a5d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08a813e280 0x7f08a8144f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:28.959 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f08a6d9d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08a8141120 0x7f08a81454d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:28.959 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f08a5d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08a813e280 0x7f08a8144f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54978/0 (socket says 172.21.15.130:54978) 2024-06-11T17:33:28.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f08a5d9b640 1 -- 172.21.15.130:0/898868325 learned_addr learned my addr 172.21.15.130:0/898868325 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:33:28.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f08a659c640 1 --2- 172.21.15.130:0/898868325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08a80aca80 0x7f08a81dce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:28.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f08a5d9b640 1 -- 172.21.15.130:0/898868325 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08a8141120 msgr2=0x7f08a81454d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:28.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f08a5d9b640 1 --2- 172.21.15.130:0/898868325 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08a8141120 0x7f08a81454d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:28.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f08a5d9b640 1 -- 172.21.15.130:0/898868325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08a80aca80 msgr2=0x7f08a81dce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:28.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f08a5d9b640 1 --2- 172.21.15.130:0/898868325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08a80aca80 0x7f08a81dce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:28.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f08a5d9b640 1 -- 172.21.15.130:0/898868325 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a814acf0 con 0x7f08a813e280 2024-06-11T17:33:28.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f08a6d9d640 1 --2- 172.21.15.130:0/898868325 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08a8141120 0x7f08a81454d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:33:28.961 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f08a5d9b640 1 --2- 172.21.15.130:0/898868325 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08a813e280 0x7f08a8144f90 secure :-1 s=READY pgs=4051 cs=0 l=1 rev1=1 crypto rx=0x7f089c00d7d0 tx=0x7f089c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:28.961 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f0896ffd640 1 -- 172.21.15.130:0/898868325 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089c004030 con 0x7f08a813e280 2024-06-11T17:33:28.961 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f0896ffd640 1 -- 172.21.15.130:0/898868325 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f089c004210 con 0x7f08a813e280 2024-06-11T17:33:28.961 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f08ac839640 1 -- 172.21.15.130:0/898868325 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08a814af20 con 0x7f08a813e280 2024-06-11T17:33:28.961 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f0896ffd640 1 -- 172.21.15.130:0/898868325 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089c00b6c0 con 0x7f08a813e280 2024-06-11T17:33:28.961 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.957+0000 7f08ac839640 1 -- 172.21.15.130:0/898868325 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08a81dd990 con 0x7f08a813e280 2024-06-11T17:33:28.961 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.961+0000 7f08ac839640 1 -- 172.21.15.130:0/898868325 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08a813dd40 con 0x7f08a813e280 2024-06-11T17:33:28.962 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.961+0000 7f0896ffd640 1 -- 172.21.15.130:0/898868325 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f089c00b860 con 0x7f08a813e280 2024-06-11T17:33:28.962 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.961+0000 7f0896ffd640 1 --2- 172.21.15.130:0/898868325 >> v2:172.21.15.130:6816/3863300924 conn(0x7f0888070d60 0x7f0888073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:28.962 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.961+0000 7f08a659c640 1 --2- 172.21.15.130:0/898868325 >> v2:172.21.15.130:6816/3863300924 conn(0x7f0888070d60 0x7f0888073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:28.963 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.961+0000 7f0896ffd640 1 -- 172.21.15.130:0/898868325 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(702..702 src has 449..702) ==== 5253+0+0 (secure 0 0 0) 0x7f089c0911c0 con 0x7f08a813e280 2024-06-11T17:33:28.963 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.961+0000 7f08a659c640 1 --2- 172.21.15.130:0/898868325 >> v2:172.21.15.130:6816/3863300924 conn(0x7f0888070d60 0x7f0888073220 secure :-1 s=READY pgs=3442 cs=0 l=1 rev1=1 crypto rx=0x7f08980ae000 tx=0x7f08980a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:28.963 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:28.965+0000 7f0896ffd640 1 -- 172.21.15.130:0/898868325 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7f089c05d670 con 0x7f08a813e280 2024-06-11T17:33:29.125 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.125+0000 7f08ac839640 1 -- 172.21.15.130:0/898868325 --> v2:172.21.15.130:6816/3863300924 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f08a80b4490 con 0x7f0888070d60 2024-06-11T17:33:29.125 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.125+0000 7f0896ffd640 1 -- 172.21.15.130:0/898868325 <== mgr.4107 v2:172.21.15.130:6816/3863300924 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f08a80b4490 con 0x7f0888070d60 2024-06-11T17:33:29.126 INFO:teuthology.orchestra.run.smithi130.stderr:instructed osd(s) 1 to deep-scrub 2024-06-11T17:33:29.128 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.129+0000 7f08ac839640 1 -- 172.21.15.130:0/898868325 >> v2:172.21.15.130:6816/3863300924 conn(0x7f0888070d60 msgr2=0x7f0888073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:29.128 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.129+0000 7f08ac839640 1 --2- 172.21.15.130:0/898868325 >> v2:172.21.15.130:6816/3863300924 conn(0x7f0888070d60 0x7f0888073220 secure :-1 s=READY pgs=3442 cs=0 l=1 rev1=1 crypto rx=0x7f08980ae000 tx=0x7f08980a7070 comp rx=0 tx=0).stop 2024-06-11T17:33:29.128 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.129+0000 7f08ac839640 1 -- 172.21.15.130:0/898868325 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08a813e280 msgr2=0x7f08a8144f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:29.128 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.129+0000 7f08ac839640 1 --2- 172.21.15.130:0/898868325 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08a813e280 0x7f08a8144f90 secure :-1 s=READY pgs=4051 cs=0 l=1 rev1=1 crypto rx=0x7f089c00d7d0 tx=0x7f089c00dc90 comp rx=0 tx=0).stop 2024-06-11T17:33:29.128 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.129+0000 7f08ac839640 1 -- 172.21.15.130:0/898868325 shutdown_connections 2024-06-11T17:33:29.129 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.129+0000 7f08ac839640 1 --2- 172.21.15.130:0/898868325 >> v2:172.21.15.130:6816/3863300924 conn(0x7f0888070d60 0x7f0888073220 unknown :-1 s=CLOSED pgs=3442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:29.129 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.129+0000 7f08ac839640 1 --2- 172.21.15.130:0/898868325 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08a8141120 0x7f08a81454d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:29.129 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.129+0000 7f08ac839640 1 --2- 172.21.15.130:0/898868325 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08a813e280 0x7f08a8144f90 unknown :-1 s=CLOSED pgs=4051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:29.129 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.129+0000 7f08ac839640 1 --2- 172.21.15.130:0/898868325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08a80aca80 0x7f08a81dce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:29.129 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.129+0000 7f08ac839640 1 -- 172.21.15.130:0/898868325 >> 172.21.15.130:0/898868325 conn(0x7f08a80b46b0 msgr2=0x7f08a80aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:29.129 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.129+0000 7f08ac839640 1 -- 172.21.15.130:0/898868325 shutdown_connections 2024-06-11T17:33:29.129 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.129+0000 7f08ac839640 1 -- 172.21.15.130:0/898868325 wait complete. 2024-06-11T17:33:29.144 INFO:tasks.ceph:Scrubbing osd.2 2024-06-11T17:33:29.144 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-06-11T17:33:29.259 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.261+0000 7fa143977640 1 Processor -- start 2024-06-11T17:33:29.259 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.261+0000 7fa143977640 1 -- start start 2024-06-11T17:33:29.261 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.261+0000 7fa143977640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa13c0af120 0x7fa13c14c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:29.261 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.261+0000 7fa143977640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa13c1417c0 con 0x7fa13c0ad2c0 2024-06-11T17:33:29.261 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.261+0000 7fa143977640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa13c0ae9f0 con 0x7fa13c0acb60 2024-06-11T17:33:29.261 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.261+0000 7fa143977640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fa13c0ad6a0 con 0x7fa13c0af120 2024-06-11T17:33:29.261 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.261+0000 7fa141713640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fa13c0ad2c0 0x7fa13c1410b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:60814/0 (socket says 172.21.15.130:60814) 2024-06-11T17:33:29.261 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.261+0000 7fa141713640 1 -- 172.21.15.130:0/741863347 learned_addr learned my addr 172.21.15.130:0/741863347 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-06-11T17:33:29.262 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.261+0000 7fa141f14640 1 --2- 172.21.15.130:0/741863347 >> v2:172.21.15.130:3300/0 conn(0x7fa13c0af120 0x7fa13c14c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:29.262 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.261+0000 7fa13bfff640 1 -- 172.21.15.130:0/741863347 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 385858149 0 0) 0x7fa13c1417c0 con 0x7fa13c0ad2c0 2024-06-11T17:33:29.262 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.261+0000 7fa13bfff640 1 -- 172.21.15.130:0/741863347 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa124003530 con 0x7fa13c0ad2c0 2024-06-11T17:33:29.262 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.261+0000 7fa141f14640 1 -- 172.21.15.130:0/741863347 >> v1:172.21.15.172:6789/0 conn(0x7fa13c0acb60 legacy=0x7fa13c13a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:29.262 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.261+0000 7fa141f14640 1 -- 172.21.15.130:0/741863347 >> v1:172.21.15.130:6789/0 conn(0x7fa13c0ad2c0 legacy=0x7fa13c1410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:29.263 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.261+0000 7fa141f14640 1 -- 172.21.15.130:0/741863347 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa13c0aecd0 con 0x7fa13c0af120 2024-06-11T17:33:29.264 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa141f14640 1 --2- 172.21.15.130:0/741863347 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa13c0af120 0x7fa13c14c1d0 secure :-1 s=READY pgs=4053 cs=0 l=1 rev1=1 crypto rx=0x7fa12c0097c0 tx=0x7fa12c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11e0575377894ca0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:29.264 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa13bfff640 1 -- 172.21.15.130:0/741863347 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12c0b1070 con 0x7fa13c0af120 2024-06-11T17:33:29.264 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa13bfff640 1 -- 172.21.15.130:0/741863347 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa12c0ac620 con 0x7fa13c0af120 2024-06-11T17:33:29.264 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa13bfff640 1 -- 172.21.15.130:0/741863347 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12c0ac9f0 con 0x7fa13c0af120 2024-06-11T17:33:29.265 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa143977640 1 -- 172.21.15.130:0/741863347 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa13c0af120 msgr2=0x7fa13c14c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:29.265 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa143977640 1 --2- 172.21.15.130:0/741863347 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa13c0af120 0x7fa13c14c1d0 secure :-1 s=READY pgs=4053 cs=0 l=1 rev1=1 crypto rx=0x7fa12c0097c0 tx=0x7fa12c01c3c0 comp rx=0 tx=0).stop 2024-06-11T17:33:29.265 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa143977640 1 -- 172.21.15.130:0/741863347 shutdown_connections 2024-06-11T17:33:29.265 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa143977640 1 --2- 172.21.15.130:0/741863347 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa13c0af120 0x7fa13c14c1d0 unknown :-1 s=CLOSED pgs=4053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:29.265 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa143977640 1 -- 172.21.15.130:0/741863347 >> 172.21.15.130:0/741863347 conn(0x7fa13c06cb60 msgr2=0x7fa13c0b4720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:29.265 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa143977640 1 -- 172.21.15.130:0/741863347 shutdown_connections 2024-06-11T17:33:29.265 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa143977640 1 -- 172.21.15.130:0/741863347 wait complete. 2024-06-11T17:33:29.265 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa143977640 1 Processor -- start 2024-06-11T17:33:29.266 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa143977640 1 -- start start 2024-06-11T17:33:29.268 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa143977640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa13c0acb60 0x7fa13c0abea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:29.268 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa143977640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa13c0ad2c0 0x7fa13c143290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:29.269 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa143977640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa13c0af120 0x7fa13c1437d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:29.269 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa143977640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa13c14f0b0 con 0x7fa13c0acb60 2024-06-11T17:33:29.269 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa143977640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa13c14ef30 con 0x7fa13c0af120 2024-06-11T17:33:29.269 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa143977640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa13c14f230 con 0x7fa13c0ad2c0 2024-06-11T17:33:29.269 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa141713640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa13c0acb60 0x7fa13c0abea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:29.269 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa141713640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa13c0acb60 0x7fa13c0abea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54990/0 (socket says 172.21.15.130:54990) 2024-06-11T17:33:29.269 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa141713640 1 -- 172.21.15.130:0/1243426140 learned_addr learned my addr 172.21.15.130:0/1243426140 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:33:29.269 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa140f12640 1 --2- 172.21.15.130:0/1243426140 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa13c0ad2c0 0x7fa13c143290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:29.269 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa141f14640 1 --2- 172.21.15.130:0/1243426140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa13c0af120 0x7fa13c1437d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:29.270 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa141713640 1 -- 172.21.15.130:0/1243426140 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa13c0ad2c0 msgr2=0x7fa13c143290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:29.270 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa141713640 1 --2- 172.21.15.130:0/1243426140 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa13c0ad2c0 0x7fa13c143290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:29.270 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa141713640 1 -- 172.21.15.130:0/1243426140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa13c0af120 msgr2=0x7fa13c1437d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:29.270 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa141713640 1 --2- 172.21.15.130:0/1243426140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa13c0af120 0x7fa13c1437d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:29.270 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa141713640 1 -- 172.21.15.130:0/1243426140 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa13c149de0 con 0x7fa13c0acb60 2024-06-11T17:33:29.270 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa140f12640 1 --2- 172.21.15.130:0/1243426140 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa13c0ad2c0 0x7fa13c143290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:33:29.270 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa141f14640 1 --2- 172.21.15.130:0/1243426140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa13c0af120 0x7fa13c1437d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-11T17:33:29.271 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa141713640 1 --2- 172.21.15.130:0/1243426140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa13c0acb60 0x7fa13c0abea0 secure :-1 s=READY pgs=4054 cs=0 l=1 rev1=1 crypto rx=0x7fa13400cbc0 tx=0x7fa13400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:29.271 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa139ffb640 1 -- 172.21.15.130:0/1243426140 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa13400ad40 con 0x7fa13c0acb60 2024-06-11T17:33:29.271 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa139ffb640 1 -- 172.21.15.130:0/1243426140 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa134012400 con 0x7fa13c0acb60 2024-06-11T17:33:29.271 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa143977640 1 -- 172.21.15.130:0/1243426140 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa13c14a120 con 0x7fa13c0acb60 2024-06-11T17:33:29.271 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa139ffb640 1 -- 172.21.15.130:0/1243426140 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1340127f0 con 0x7fa13c0acb60 2024-06-11T17:33:29.271 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.265+0000 7fa143977640 1 -- 172.21.15.130:0/1243426140 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa13c1499e0 con 0x7fa13c0acb60 2024-06-11T17:33:29.271 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.269+0000 7fa143977640 1 -- 172.21.15.130:0/1243426140 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa13c13a4e0 con 0x7fa13c0acb60 2024-06-11T17:33:29.271 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.269+0000 7fa139ffb640 1 -- 172.21.15.130:0/1243426140 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7fa134012990 con 0x7fa13c0acb60 2024-06-11T17:33:29.271 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.269+0000 7fa139ffb640 1 --2- 172.21.15.130:0/1243426140 >> v2:172.21.15.130:6816/3863300924 conn(0x7fa128070d90 0x7fa128073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:29.272 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.269+0000 7fa139ffb640 1 -- 172.21.15.130:0/1243426140 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(702..702 src has 449..702) ==== 5253+0+0 (secure 0 0 0) 0x7fa134091e70 con 0x7fa13c0acb60 2024-06-11T17:33:29.272 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.269+0000 7fa140f12640 1 --2- 172.21.15.130:0/1243426140 >> v2:172.21.15.130:6816/3863300924 conn(0x7fa128070d90 0x7fa128073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:29.272 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.269+0000 7fa139ffb640 1 --2- 172.21.15.130:0/1243426140 >> v2:172.21.15.130:6808/272447947 conn(0x7fa1280786b0 0x7fa12807ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:29.272 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.269+0000 7fa139ffb640 1 -- 172.21.15.130:0/1243426140 --> v2:172.21.15.130:6808/272447947 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa134006e50 con 0x7fa1280786b0 2024-06-11T17:33:29.272 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.269+0000 7fa139ffb640 1 -- 172.21.15.130:0/1243426140 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_get_version_reply(handle=1 version=702) ==== 24+0+0 (secure 0 0 0) 0x7fa134092300 con 0x7fa13c0acb60 2024-06-11T17:33:29.272 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.269+0000 7fa141f14640 1 --2- 172.21.15.130:0/1243426140 >> v2:172.21.15.130:6808/272447947 conn(0x7fa1280786b0 0x7fa12807ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:29.272 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.269+0000 7fa140f12640 1 --2- 172.21.15.130:0/1243426140 >> v2:172.21.15.130:6816/3863300924 conn(0x7fa128070d90 0x7fa128073250 secure :-1 s=READY pgs=3443 cs=0 l=1 rev1=1 crypto rx=0x7fa13c0b0220 tx=0x7fa130009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:29.273 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.269+0000 7fa141f14640 1 --2- 172.21.15.130:0/1243426140 >> v2:172.21.15.130:6808/272447947 conn(0x7fa1280786b0 0x7fa12807ab50 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:29.273 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.269+0000 7fa139ffb640 1 -- 172.21.15.130:0/1243426140 <== osd.2 v2:172.21.15.130:6808/272447947 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa134006e50 con 0x7fa1280786b0 2024-06-11T17:33:29.281 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.281+0000 7fa143977640 1 -- 172.21.15.130:0/1243426140 --> v2:172.21.15.130:6808/272447947 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa13c143f60 con 0x7fa1280786b0 2024-06-11T17:33:29.281 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.281+0000 7fa139ffb640 1 -- 172.21.15.130:0/1243426140 <== osd.2 v2:172.21.15.130:6808/272447947 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa13c143f60 con 0x7fa1280786b0 2024-06-11T17:33:29.282 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-06-11T17:33:29.282 INFO:teuthology.orchestra.run.smithi130.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-11T17:33:29.282 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-06-11T17:33:29.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.281+0000 7fa143977640 1 -- 172.21.15.130:0/1243426140 >> v2:172.21.15.130:6808/272447947 conn(0x7fa1280786b0 msgr2=0x7fa12807ab50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:29.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.281+0000 7fa143977640 1 --2- 172.21.15.130:0/1243426140 >> v2:172.21.15.130:6808/272447947 conn(0x7fa1280786b0 0x7fa12807ab50 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:29.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.281+0000 7fa143977640 1 -- 172.21.15.130:0/1243426140 >> v2:172.21.15.130:6816/3863300924 conn(0x7fa128070d90 msgr2=0x7fa128073250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:29.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.281+0000 7fa143977640 1 --2- 172.21.15.130:0/1243426140 >> v2:172.21.15.130:6816/3863300924 conn(0x7fa128070d90 0x7fa128073250 secure :-1 s=READY pgs=3443 cs=0 l=1 rev1=1 crypto rx=0x7fa13c0b0220 tx=0x7fa130009040 comp rx=0 tx=0).stop 2024-06-11T17:33:29.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.281+0000 7fa143977640 1 -- 172.21.15.130:0/1243426140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa13c0acb60 msgr2=0x7fa13c0abea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:29.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.281+0000 7fa143977640 1 --2- 172.21.15.130:0/1243426140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa13c0acb60 0x7fa13c0abea0 secure :-1 s=READY pgs=4054 cs=0 l=1 rev1=1 crypto rx=0x7fa13400cbc0 tx=0x7fa13400a430 comp rx=0 tx=0).stop 2024-06-11T17:33:29.284 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.281+0000 7fa141f14640 1 -- 172.21.15.130:0/1243426140 reap_dead start 2024-06-11T17:33:29.284 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.281+0000 7fa143977640 1 -- 172.21.15.130:0/1243426140 shutdown_connections 2024-06-11T17:33:29.284 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.281+0000 7fa143977640 1 -- 172.21.15.130:0/1243426140 >> 172.21.15.130:0/1243426140 conn(0x7fa13c06cb60 msgr2=0x7fa13c0b45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:29.284 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.281+0000 7fa143977640 1 -- 172.21.15.130:0/1243426140 shutdown_connections 2024-06-11T17:33:29.284 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.281+0000 7fa143977640 1 -- 172.21.15.130:0/1243426140 wait complete. 2024-06-11T17:33:29.296 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-06-11T17:33:29.408 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.409+0000 7f1fc974e640 1 Processor -- start 2024-06-11T17:33:29.409 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.409+0000 7f1fc974e640 1 -- start start 2024-06-11T17:33:29.410 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.409+0000 7f1fc974e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1fc40af310 0x7f1fc413f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:29.410 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.409+0000 7f1fc974e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1fc40ae6a0 0x7f1fc413ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:29.410 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.409+0000 7f1fc974e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1fc40aeaa0 0x7f1fc413cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:29.411 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.409+0000 7f1fc974e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f1fc40af6f0 con 0x7f1fc40aeaa0 2024-06-11T17:33:29.411 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.409+0000 7f1fc974e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f1fc40aca90 con 0x7f1fc40ae6a0 2024-06-11T17:33:29.411 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.409+0000 7f1fc974e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f1fc40ad920 con 0x7f1fc40af310 2024-06-11T17:33:29.411 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.409+0000 7f1fc37fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1fc40aeaa0 0x7f1fc413cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:29.411 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.409+0000 7f1fc2ffd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1fc40af310 0x7f1fc413f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:29.411 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.409+0000 7f1fc37fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1fc40aeaa0 0x7f1fc413cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54992/0 (socket says 172.21.15.130:54992) 2024-06-11T17:33:29.411 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.409+0000 7f1fc37fe640 1 -- 172.21.15.130:0/2662098453 learned_addr learned my addr 172.21.15.130:0/2662098453 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:33:29.411 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.409+0000 7f1fc2ffd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1fc40af310 0x7f1fc413f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:35166/0 (socket says 172.21.15.130:35166) 2024-06-11T17:33:29.412 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.409+0000 7f1fbbfff640 1 --2- 172.21.15.130:0/2662098453 >> v2:172.21.15.172:3300/0 conn(0x7f1fc40ae6a0 0x7f1fc413ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:29.412 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.409+0000 7f1fc37fe640 1 -- 172.21.15.130:0/2662098453 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1fc40af310 msgr2=0x7f1fc413f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:33:29.412 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.409+0000 7f1fc37fe640 1 --2- 172.21.15.130:0/2662098453 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1fc40af310 0x7f1fc413f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:29.412 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.409+0000 7f1fc37fe640 1 -- 172.21.15.130:0/2662098453 >> v2:172.21.15.172:3300/0 conn(0x7f1fc40ae6a0 msgr2=0x7f1fc413ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:33:29.412 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.409+0000 7f1fc37fe640 1 --2- 172.21.15.130:0/2662098453 >> v2:172.21.15.172:3300/0 conn(0x7f1fc40ae6a0 0x7f1fc413ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:29.412 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.409+0000 7f1fc37fe640 1 -- 172.21.15.130:0/2662098453 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc40adc00 con 0x7f1fc40aeaa0 2024-06-11T17:33:29.412 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.409+0000 7f1fc2ffd640 1 --2- 172.21.15.130:0/2662098453 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1fc40af310 0x7f1fc413f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:33:29.413 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.413+0000 7f1fc37fe640 1 --2- 172.21.15.130:0/2662098453 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1fc40aeaa0 0x7f1fc413cfc0 secure :-1 s=READY pgs=4055 cs=0 l=1 rev1=1 crypto rx=0x7f1fc406da80 tx=0x7f1fbc01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87340122b19f51b3 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:29.414 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.413+0000 7f1fc27fc640 1 -- 172.21.15.130:0/2662098453 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc0a56d0 con 0x7f1fc40aeaa0 2024-06-11T17:33:29.414 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.413+0000 7f1fc27fc640 1 -- 172.21.15.130:0/2662098453 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fbc0a5870 con 0x7f1fc40aeaa0 2024-06-11T17:33:29.414 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.413+0000 7f1fc27fc640 1 -- 172.21.15.130:0/2662098453 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc0a5c40 con 0x7f1fc40aeaa0 2024-06-11T17:33:29.414 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.413+0000 7f1fc974e640 1 -- 172.21.15.130:0/2662098453 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1fc40aeaa0 msgr2=0x7f1fc413cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:29.414 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.413+0000 7f1fc974e640 1 --2- 172.21.15.130:0/2662098453 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1fc40aeaa0 0x7f1fc413cfc0 secure :-1 s=READY pgs=4055 cs=0 l=1 rev1=1 crypto rx=0x7f1fc406da80 tx=0x7f1fbc01c940 comp rx=0 tx=0).stop 2024-06-11T17:33:29.414 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.413+0000 7f1fc974e640 1 -- 172.21.15.130:0/2662098453 shutdown_connections 2024-06-11T17:33:29.414 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.413+0000 7f1fc974e640 1 --2- 172.21.15.130:0/2662098453 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1fc40aeaa0 0x7f1fc413cfc0 unknown :-1 s=CLOSED pgs=4055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:29.414 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.413+0000 7f1fc974e640 1 --2- 172.21.15.130:0/2662098453 >> v2:172.21.15.172:3300/0 conn(0x7f1fc40ae6a0 0x7f1fc413ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:29.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.413+0000 7f1fc974e640 1 --2- 172.21.15.130:0/2662098453 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1fc40af310 0x7f1fc413f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:29.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.413+0000 7f1fc974e640 1 -- 172.21.15.130:0/2662098453 >> 172.21.15.130:0/2662098453 conn(0x7f1fc40b46b0 msgr2=0x7f1fc40b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:29.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.413+0000 7f1fc974e640 1 -- 172.21.15.130:0/2662098453 shutdown_connections 2024-06-11T17:33:29.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.413+0000 7f1fc974e640 1 -- 172.21.15.130:0/2662098453 wait complete. 2024-06-11T17:33:29.417 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.417+0000 7f1fc974e640 1 Processor -- start 2024-06-11T17:33:29.417 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.417+0000 7f1fc974e640 1 -- start start 2024-06-11T17:33:29.417 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.417+0000 7f1fc974e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fc40ae6a0 0x7f1fc4148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:29.417 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.417+0000 7f1fc974e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1fc40aeaa0 0x7f1fc41d7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:29.417 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.417+0000 7f1fc974e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1fc40af310 0x7f1fc41d84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:29.418 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.417+0000 7f1fc974e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc4143900 con 0x7f1fc40af310 2024-06-11T17:33:29.418 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.417+0000 7f1fc974e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc4143780 con 0x7f1fc40ae6a0 2024-06-11T17:33:29.418 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.417+0000 7f1fc974e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f1fc4143a80 con 0x7f1fc40aeaa0 2024-06-11T17:33:29.418 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.417+0000 7f1fbbfff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1fc40aeaa0 0x7f1fc41d7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:29.418 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.417+0000 7f1fc37fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1fc40af310 0x7f1fc41d84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:29.418 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.417+0000 7f1fbbfff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1fc40aeaa0 0x7f1fc41d7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:35176/0 (socket says 172.21.15.130:35176) 2024-06-11T17:33:29.418 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.417+0000 7f1fc37fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1fc40af310 0x7f1fc41d84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:55006/0 (socket says 172.21.15.130:55006) 2024-06-11T17:33:29.418 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.417+0000 7f1fbbfff640 1 -- 172.21.15.130:0/2682468956 learned_addr learned my addr 172.21.15.130:0/2682468956 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:33:29.419 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.417+0000 7f1fc2ffd640 1 --2- 172.21.15.130:0/2682468956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fc40ae6a0 0x7f1fc4148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:29.419 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.417+0000 7f1fbbfff640 1 -- 172.21.15.130:0/2682468956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fc40ae6a0 msgr2=0x7f1fc4148ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:29.419 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.417+0000 7f1fbbfff640 1 --2- 172.21.15.130:0/2682468956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fc40ae6a0 0x7f1fc4148ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:29.419 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.417+0000 7f1fbbfff640 1 -- 172.21.15.130:0/2682468956 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1fc40af310 msgr2=0x7f1fc41d84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:29.419 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.417+0000 7f1fbbfff640 1 --2- 172.21.15.130:0/2682468956 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1fc40af310 0x7f1fc41d84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:29.419 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.417+0000 7f1fbbfff640 1 -- 172.21.15.130:0/2682468956 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc406f2c0 con 0x7f1fc40aeaa0 2024-06-11T17:33:29.419 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.417+0000 7f1fc37fe640 1 --2- 172.21.15.130:0/2682468956 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1fc40af310 0x7f1fc41d84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:33:29.419 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.417+0000 7f1fc2ffd640 1 --2- 172.21.15.130:0/2682468956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fc40ae6a0 0x7f1fc4148ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-11T17:33:29.420 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.417+0000 7f1fbbfff640 1 --2- 172.21.15.130:0/2682468956 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1fc40aeaa0 0x7f1fc41d7f60 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 crypto rx=0x7f1fb400d800 tx=0x7f1fb400dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:29.420 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.417+0000 7f1fbb7fe640 1 -- 172.21.15.130:0/2682468956 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb4004020 con 0x7f1fc40aeaa0 2024-06-11T17:33:29.420 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.417+0000 7f1fbb7fe640 1 -- 172.21.15.130:0/2682468956 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb40041c0 con 0x7f1fc40aeaa0 2024-06-11T17:33:29.420 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.417+0000 7f1fbb7fe640 1 -- 172.21.15.130:0/2682468956 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb40043b0 con 0x7f1fc40aeaa0 2024-06-11T17:33:29.420 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.417+0000 7f1fc974e640 1 -- 172.21.15.130:0/2682468956 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fc406f530 con 0x7f1fc40aeaa0 2024-06-11T17:33:29.420 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.417+0000 7f1fc974e640 1 -- 172.21.15.130:0/2682468956 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fc406faf0 con 0x7f1fc40aeaa0 2024-06-11T17:33:29.420 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.417+0000 7f1fc974e640 1 -- 172.21.15.130:0/2682468956 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fc413f800 con 0x7f1fc40aeaa0 2024-06-11T17:33:29.421 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.417+0000 7f1fbb7fe640 1 -- 172.21.15.130:0/2682468956 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f1fb401b020 con 0x7f1fc40aeaa0 2024-06-11T17:33:29.421 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.421+0000 7f1fbb7fe640 1 --2- 172.21.15.130:0/2682468956 >> v2:172.21.15.130:6816/3863300924 conn(0x7f1fa4070d60 0x7f1fa4073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:29.421 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.421+0000 7f1fbb7fe640 1 -- 172.21.15.130:0/2682468956 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(702..702 src has 449..702) ==== 5253+0+0 (secure 0 0 0) 0x7f1fb4090be0 con 0x7f1fc40aeaa0 2024-06-11T17:33:29.422 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.421+0000 7f1fc2ffd640 1 --2- 172.21.15.130:0/2682468956 >> v2:172.21.15.130:6816/3863300924 conn(0x7f1fa4070d60 0x7f1fa4073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:29.422 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.421+0000 7f1fc2ffd640 1 --2- 172.21.15.130:0/2682468956 >> v2:172.21.15.130:6816/3863300924 conn(0x7f1fa4070d60 0x7f1fa4073220 secure :-1 s=READY pgs=3444 cs=0 l=1 rev1=1 crypto rx=0x7f1fac009a90 tx=0x7f1fac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:29.422 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.425+0000 7f1fbb7fe640 1 -- 172.21.15.130:0/2682468956 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7f1fb405d130 con 0x7f1fc40aeaa0 2024-06-11T17:33:29.574 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.577+0000 7f1fc974e640 1 -- 172.21.15.130:0/2682468956 --> v2:172.21.15.130:6816/3863300924 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f1fc4149050 con 0x7f1fa4070d60 2024-06-11T17:33:29.575 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.577+0000 7f1fbb7fe640 1 -- 172.21.15.130:0/2682468956 <== mgr.4107 v2:172.21.15.130:6816/3863300924 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1fc4149050 con 0x7f1fa4070d60 2024-06-11T17:33:29.575 INFO:teuthology.orchestra.run.smithi130.stderr:instructed osd(s) 2 to deep-scrub 2024-06-11T17:33:29.577 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.577+0000 7f1fc974e640 1 -- 172.21.15.130:0/2682468956 >> v2:172.21.15.130:6816/3863300924 conn(0x7f1fa4070d60 msgr2=0x7f1fa4073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:29.577 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.577+0000 7f1fc974e640 1 --2- 172.21.15.130:0/2682468956 >> v2:172.21.15.130:6816/3863300924 conn(0x7f1fa4070d60 0x7f1fa4073220 secure :-1 s=READY pgs=3444 cs=0 l=1 rev1=1 crypto rx=0x7f1fac009a90 tx=0x7f1fac008040 comp rx=0 tx=0).stop 2024-06-11T17:33:29.577 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.577+0000 7f1fc974e640 1 -- 172.21.15.130:0/2682468956 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1fc40aeaa0 msgr2=0x7f1fc41d7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:29.577 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.577+0000 7f1fc974e640 1 --2- 172.21.15.130:0/2682468956 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1fc40aeaa0 0x7f1fc41d7f60 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 crypto rx=0x7f1fb400d800 tx=0x7f1fb400dcc0 comp rx=0 tx=0).stop 2024-06-11T17:33:29.577 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.577+0000 7f1fc974e640 1 -- 172.21.15.130:0/2682468956 shutdown_connections 2024-06-11T17:33:29.578 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.577+0000 7f1fc974e640 1 --2- 172.21.15.130:0/2682468956 >> v2:172.21.15.130:6816/3863300924 conn(0x7f1fa4070d60 0x7f1fa4073220 unknown :-1 s=CLOSED pgs=3444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:29.578 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.577+0000 7f1fc974e640 1 --2- 172.21.15.130:0/2682468956 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1fc40af310 0x7f1fc41d84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:29.578 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.577+0000 7f1fc974e640 1 --2- 172.21.15.130:0/2682468956 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1fc40aeaa0 0x7f1fc41d7f60 unknown :-1 s=CLOSED pgs=2312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:29.578 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.577+0000 7f1fc974e640 1 --2- 172.21.15.130:0/2682468956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fc40ae6a0 0x7f1fc4148ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:29.578 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.577+0000 7f1fc974e640 1 -- 172.21.15.130:0/2682468956 >> 172.21.15.130:0/2682468956 conn(0x7f1fc40b46b0 msgr2=0x7f1fc4141050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:29.578 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.577+0000 7f1fc974e640 1 -- 172.21.15.130:0/2682468956 shutdown_connections 2024-06-11T17:33:29.578 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.577+0000 7f1fc974e640 1 -- 172.21.15.130:0/2682468956 wait complete. 2024-06-11T17:33:29.593 INFO:tasks.ceph:Scrubbing osd.3 2024-06-11T17:33:29.593 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-06-11T17:33:29.716 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.717+0000 7f6d4e851640 1 Processor -- start 2024-06-11T17:33:29.716 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.717+0000 7f6d4e851640 1 -- start start 2024-06-11T17:33:29.718 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.717+0000 7f6d4e851640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6d480ad2c0 0x7f6d480af120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:29.718 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.717+0000 7f6d4e851640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d4813a4e0 0x7f6d4813a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:29.718 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.717+0000 7f6d4e851640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d481417c0 con 0x7f6d480acb60 2024-06-11T17:33:29.718 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.717+0000 7f6d4e851640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f6d480ad6a0 con 0x7f6d480ad2c0 2024-06-11T17:33:29.718 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.717+0000 7f6d4e851640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f6d480ae9f0 con 0x7f6d4813a4e0 2024-06-11T17:33:29.719 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.717+0000 7f6d477fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f6d480acb60 0x7f6d481410b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:60826/0 (socket says 172.21.15.130:60826) 2024-06-11T17:33:29.719 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.717+0000 7f6d477fe640 1 -- 172.21.15.130:0/1677984534 learned_addr learned my addr 172.21.15.130:0/1677984534 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-06-11T17:33:29.719 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.717+0000 7f6d4cdee640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d4813a4e0 0x7f6d4813a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:29.719 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.717+0000 7f6d47fff640 1 --2- 172.21.15.130:0/1677984534 >> v2:172.21.15.172:3300/0 conn(0x7f6d480ad2c0 0x7f6d480af120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:29.719 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.717+0000 7f6d46ffd640 1 -- 172.21.15.130:0/1677984534 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3357111219 0 0) 0x7f6d481417c0 con 0x7f6d480acb60 2024-06-11T17:33:29.719 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.717+0000 7f6d46ffd640 1 -- 172.21.15.130:0/1677984534 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d30003530 con 0x7f6d480acb60 2024-06-11T17:33:29.719 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.717+0000 7f6d4cdee640 1 -- 172.21.15.130:0/1677984534 >> v2:172.21.15.172:3300/0 conn(0x7f6d480ad2c0 msgr2=0x7f6d480af120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:33:29.719 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.717+0000 7f6d4cdee640 1 --2- 172.21.15.130:0/1677984534 >> v2:172.21.15.172:3300/0 conn(0x7f6d480ad2c0 0x7f6d480af120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:29.720 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.717+0000 7f6d4cdee640 1 -- 172.21.15.130:0/1677984534 >> v1:172.21.15.130:6789/0 conn(0x7f6d480acb60 legacy=0x7f6d481410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:29.720 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.717+0000 7f6d4cdee640 1 -- 172.21.15.130:0/1677984534 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d480aecd0 con 0x7f6d4813a4e0 2024-06-11T17:33:29.720 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.717+0000 7f6d47fff640 1 --2- 172.21.15.130:0/1677984534 >> v2:172.21.15.172:3300/0 conn(0x7f6d480ad2c0 0x7f6d480af120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-11T17:33:29.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.721+0000 7f6d4cdee640 1 --2- 172.21.15.130:0/1677984534 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d4813a4e0 0x7f6d4813a970 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 crypto rx=0x7f6d400097c0 tx=0x7f6d4001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50487dac4d45b75 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:29.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.721+0000 7f6d46ffd640 1 -- 172.21.15.130:0/1677984534 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d400b0070 con 0x7f6d4813a4e0 2024-06-11T17:33:29.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.721+0000 7f6d46ffd640 1 -- 172.21.15.130:0/1677984534 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d400ab600 con 0x7f6d4813a4e0 2024-06-11T17:33:29.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.721+0000 7f6d46ffd640 1 -- 172.21.15.130:0/1677984534 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d400ab9b0 con 0x7f6d4813a4e0 2024-06-11T17:33:29.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.721+0000 7f6d4e851640 1 -- 172.21.15.130:0/1677984534 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d4813a4e0 msgr2=0x7f6d4813a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:29.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.721+0000 7f6d4e851640 1 --2- 172.21.15.130:0/1677984534 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d4813a4e0 0x7f6d4813a970 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 crypto rx=0x7f6d400097c0 tx=0x7f6d4001c3c0 comp rx=0 tx=0).stop 2024-06-11T17:33:29.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.721+0000 7f6d4e851640 1 -- 172.21.15.130:0/1677984534 shutdown_connections 2024-06-11T17:33:29.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.721+0000 7f6d4e851640 1 --2- 172.21.15.130:0/1677984534 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d4813a4e0 0x7f6d4813a970 unknown :-1 s=CLOSED pgs=2313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:29.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.721+0000 7f6d4e851640 1 --2- 172.21.15.130:0/1677984534 >> v2:172.21.15.172:3300/0 conn(0x7f6d480ad2c0 0x7f6d480af120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:29.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.721+0000 7f6d4e851640 1 -- 172.21.15.130:0/1677984534 >> 172.21.15.130:0/1677984534 conn(0x7f6d4806cb60 msgr2=0x7f6d480b4720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:29.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.721+0000 7f6d4e851640 1 -- 172.21.15.130:0/1677984534 shutdown_connections 2024-06-11T17:33:29.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.721+0000 7f6d4e851640 1 -- 172.21.15.130:0/1677984534 wait complete. 2024-06-11T17:33:29.726 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.721+0000 7f6d4e851640 1 Processor -- start 2024-06-11T17:33:29.726 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.721+0000 7f6d4e851640 1 -- start start 2024-06-11T17:33:29.730 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.721+0000 7f6d4e851640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d480acb60 0x7f6d48149800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:29.730 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.721+0000 7f6d4e851640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d480ad2c0 0x7f6d481384e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:29.730 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.721+0000 7f6d4e851640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d4813a4e0 0x7f6d48138a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:29.730 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.721+0000 7f6d4e851640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4814dd70 con 0x7f6d4813a4e0 2024-06-11T17:33:29.730 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.721+0000 7f6d4e851640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4814dbf0 con 0x7f6d480ad2c0 2024-06-11T17:33:29.730 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.721+0000 7f6d4e851640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f6d4814def0 con 0x7f6d480acb60 2024-06-11T17:33:29.731 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.725+0000 7f6d47fff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d480acb60 0x7f6d48149800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:29.731 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.725+0000 7f6d4cdee640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d4813a4e0 0x7f6d48138a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:29.731 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.725+0000 7f6d4cdee640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d4813a4e0 0x7f6d48138a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:55016/0 (socket says 172.21.15.130:55016) 2024-06-11T17:33:29.731 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.725+0000 7f6d4cdee640 1 -- 172.21.15.130:0/3453191452 learned_addr learned my addr 172.21.15.130:0/3453191452 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:33:29.731 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.725+0000 7f6d47fff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d480acb60 0x7f6d48149800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:35194/0 (socket says 172.21.15.130:35194) 2024-06-11T17:33:29.731 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.725+0000 7f6d477fe640 1 --2- 172.21.15.130:0/3453191452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d480ad2c0 0x7f6d481384e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:29.732 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.725+0000 7f6d4cdee640 1 -- 172.21.15.130:0/3453191452 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d480acb60 msgr2=0x7f6d48149800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:29.732 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.725+0000 7f6d4cdee640 1 --2- 172.21.15.130:0/3453191452 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d480acb60 0x7f6d48149800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:29.732 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.725+0000 7f6d4cdee640 1 -- 172.21.15.130:0/3453191452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d480ad2c0 msgr2=0x7f6d481384e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:29.732 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.725+0000 7f6d4cdee640 1 --2- 172.21.15.130:0/3453191452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d480ad2c0 0x7f6d481384e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:29.732 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.725+0000 7f6d4cdee640 1 -- 172.21.15.130:0/3453191452 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d480ac380 con 0x7f6d4813a4e0 2024-06-11T17:33:29.732 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.725+0000 7f6d47fff640 1 --2- 172.21.15.130:0/3453191452 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d480acb60 0x7f6d48149800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:33:29.732 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.725+0000 7f6d4cdee640 1 --2- 172.21.15.130:0/3453191452 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d4813a4e0 0x7f6d48138a20 secure :-1 s=READY pgs=4057 cs=0 l=1 rev1=1 crypto rx=0x7f6d4001c1f0 tx=0x7f6d4001ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:29.733 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.725+0000 7f6d44ff9640 1 -- 172.21.15.130:0/3453191452 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d400b0050 con 0x7f6d4813a4e0 2024-06-11T17:33:29.733 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.725+0000 7f6d44ff9640 1 -- 172.21.15.130:0/3453191452 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d400b1040 con 0x7f6d4813a4e0 2024-06-11T17:33:29.733 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.725+0000 7f6d4e851640 1 -- 172.21.15.130:0/3453191452 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d48139a90 con 0x7f6d4813a4e0 2024-06-11T17:33:29.733 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.725+0000 7f6d44ff9640 1 -- 172.21.15.130:0/3453191452 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d40006e20 con 0x7f6d4813a4e0 2024-06-11T17:33:29.733 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.725+0000 7f6d4e851640 1 -- 172.21.15.130:0/3453191452 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d4813a050 con 0x7f6d4813a4e0 2024-06-11T17:33:29.733 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.725+0000 7f6d4e851640 1 -- 172.21.15.130:0/3453191452 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6d480af120 con 0x7f6d4813a4e0 2024-06-11T17:33:29.734 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.725+0000 7f6d44ff9640 1 -- 172.21.15.130:0/3453191452 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f6d400be060 con 0x7f6d4813a4e0 2024-06-11T17:33:29.734 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.725+0000 7f6d44ff9640 1 --2- 172.21.15.130:0/3453191452 >> v2:172.21.15.130:6816/3863300924 conn(0x7f6d34070d90 0x7f6d34073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:29.734 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.725+0000 7f6d47fff640 1 --2- 172.21.15.130:0/3453191452 >> v2:172.21.15.130:6816/3863300924 conn(0x7f6d34070d90 0x7f6d34073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:29.734 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.725+0000 7f6d44ff9640 1 -- 172.21.15.130:0/3453191452 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(702..702 src has 449..702) ==== 5253+0+0 (secure 0 0 0) 0x7f6d4012ac70 con 0x7f6d4813a4e0 2024-06-11T17:33:29.734 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.725+0000 7f6d44ff9640 1 --2- 172.21.15.130:0/3453191452 >> v2:172.21.15.130:6810/995804279 conn(0x7f6d340786b0 0x7f6d3407ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:29.734 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.725+0000 7f6d44ff9640 1 -- 172.21.15.130:0/3453191452 --> v2:172.21.15.130:6810/995804279 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6d40001d40 con 0x7f6d340786b0 2024-06-11T17:33:29.734 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.725+0000 7f6d44ff9640 1 -- 172.21.15.130:0/3453191452 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_get_version_reply(handle=1 version=702) ==== 24+0+0 (secure 0 0 0) 0x7f6d4012b100 con 0x7f6d4813a4e0 2024-06-11T17:33:29.735 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.725+0000 7f6d477fe640 1 --2- 172.21.15.130:0/3453191452 >> v2:172.21.15.130:6810/995804279 conn(0x7f6d340786b0 0x7f6d3407ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:29.735 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.725+0000 7f6d47fff640 1 --2- 172.21.15.130:0/3453191452 >> v2:172.21.15.130:6816/3863300924 conn(0x7f6d34070d90 0x7f6d34073250 secure :-1 s=READY pgs=3445 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c006e90 tx=0x7f6d3c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:29.735 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.725+0000 7f6d477fe640 1 --2- 172.21.15.130:0/3453191452 >> v2:172.21.15.130:6810/995804279 conn(0x7f6d340786b0 0x7f6d3407ab50 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:29.735 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.729+0000 7f6d44ff9640 1 -- 172.21.15.130:0/3453191452 <== osd.3 v2:172.21.15.130:6810/995804279 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6d40001d40 con 0x7f6d340786b0 2024-06-11T17:33:29.739 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.741+0000 7f6d4e851640 1 -- 172.21.15.130:0/3453191452 --> v2:172.21.15.130:6810/995804279 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6d48139790 con 0x7f6d340786b0 2024-06-11T17:33:29.739 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.741+0000 7f6d44ff9640 1 -- 172.21.15.130:0/3453191452 <== osd.3 v2:172.21.15.130:6810/995804279 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6d48139790 con 0x7f6d340786b0 2024-06-11T17:33:29.739 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-06-11T17:33:29.740 INFO:teuthology.orchestra.run.smithi130.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-11T17:33:29.740 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-06-11T17:33:29.741 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.741+0000 7f6d4e851640 1 -- 172.21.15.130:0/3453191452 >> v2:172.21.15.130:6810/995804279 conn(0x7f6d340786b0 msgr2=0x7f6d3407ab50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:29.741 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.741+0000 7f6d4e851640 1 --2- 172.21.15.130:0/3453191452 >> v2:172.21.15.130:6810/995804279 conn(0x7f6d340786b0 0x7f6d3407ab50 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:29.741 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.741+0000 7f6d4e851640 1 -- 172.21.15.130:0/3453191452 >> v2:172.21.15.130:6816/3863300924 conn(0x7f6d34070d90 msgr2=0x7f6d34073250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:29.741 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.741+0000 7f6d4e851640 1 --2- 172.21.15.130:0/3453191452 >> v2:172.21.15.130:6816/3863300924 conn(0x7f6d34070d90 0x7f6d34073250 secure :-1 s=READY pgs=3445 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c006e90 tx=0x7f6d3c008040 comp rx=0 tx=0).stop 2024-06-11T17:33:29.742 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.741+0000 7f6d4e851640 1 -- 172.21.15.130:0/3453191452 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d4813a4e0 msgr2=0x7f6d48138a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:29.742 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.741+0000 7f6d4e851640 1 --2- 172.21.15.130:0/3453191452 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d4813a4e0 0x7f6d48138a20 secure :-1 s=READY pgs=4057 cs=0 l=1 rev1=1 crypto rx=0x7f6d4001c1f0 tx=0x7f6d4001ac00 comp rx=0 tx=0).stop 2024-06-11T17:33:29.742 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.741+0000 7f6d4cdee640 1 -- 172.21.15.130:0/3453191452 reap_dead start 2024-06-11T17:33:29.742 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.741+0000 7f6d4e851640 1 -- 172.21.15.130:0/3453191452 shutdown_connections 2024-06-11T17:33:29.742 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.741+0000 7f6d4e851640 1 -- 172.21.15.130:0/3453191452 >> 172.21.15.130:0/3453191452 conn(0x7f6d4806cb60 msgr2=0x7f6d48136af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:29.742 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.741+0000 7f6d4e851640 1 -- 172.21.15.130:0/3453191452 shutdown_connections 2024-06-11T17:33:29.743 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.741+0000 7f6d4e851640 1 -- 172.21.15.130:0/3453191452 wait complete. 2024-06-11T17:33:29.755 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-06-11T17:33:29.863 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.865+0000 7faecd0e0640 1 Processor -- start 2024-06-11T17:33:29.863 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.865+0000 7faecd0e0640 1 -- start start 2024-06-11T17:33:29.864 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.865+0000 7faecd0e0640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7faec806e240 0x7faec80b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:29.865 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.865+0000 7faecd0e0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faec813fda0 0x7faec8140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:29.865 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.865+0000 7faecd0e0640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faec80aace0 con 0x7faec8146170 2024-06-11T17:33:29.865 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.865+0000 7faecd0e0640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7faec806e620 con 0x7faec806e240 2024-06-11T17:33:29.865 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.865+0000 7faecd0e0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7faec8146570 con 0x7faec813fda0 2024-06-11T17:33:29.865 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.865+0000 7faec659c640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7faec8146170 0x7faec80b4950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:60830/0 (socket says 172.21.15.130:60830) 2024-06-11T17:33:29.865 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.865+0000 7faec659c640 1 -- 172.21.15.130:0/2874357134 learned_addr learned my addr 172.21.15.130:0/2874357134 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-06-11T17:33:29.865 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.865+0000 7faec759e640 1 --2- 172.21.15.130:0/2874357134 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faec813fda0 0x7faec8140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:29.865 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.865+0000 7faec6d9d640 1 --2- 172.21.15.130:0/2874357134 >> v2:172.21.15.172:3300/0 conn(0x7faec806e240 0x7faec80b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:29.866 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.865+0000 7faec759e640 1 -- 172.21.15.130:0/2874357134 >> v2:172.21.15.172:3300/0 conn(0x7faec806e240 msgr2=0x7faec80b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:33:29.866 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.865+0000 7faec759e640 1 --2- 172.21.15.130:0/2874357134 >> v2:172.21.15.172:3300/0 conn(0x7faec806e240 0x7faec80b2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:29.866 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.865+0000 7faec5d9b640 1 -- 172.21.15.130:0/2874357134 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4285987542 0 0) 0x7faec80aace0 con 0x7faec8146170 2024-06-11T17:33:29.866 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.865+0000 7faec759e640 1 -- 172.21.15.130:0/2874357134 >> v1:172.21.15.130:6789/0 conn(0x7faec8146170 legacy=0x7faec80b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:29.866 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.865+0000 7faec759e640 1 -- 172.21.15.130:0/2874357134 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec8140770 con 0x7faec813fda0 2024-06-11T17:33:29.867 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faec759e640 1 --2- 172.21.15.130:0/2874357134 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faec813fda0 0x7faec8140230 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 crypto rx=0x7faec0009d90 tx=0x7faec001c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3af6eaa365723d8b server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:29.867 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faec5d9b640 1 -- 172.21.15.130:0/2874357134 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec00b2070 con 0x7faec813fda0 2024-06-11T17:33:29.867 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faec5d9b640 1 -- 172.21.15.130:0/2874357134 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faec00a5820 con 0x7faec813fda0 2024-06-11T17:33:29.867 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faec5d9b640 1 -- 172.21.15.130:0/2874357134 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec00a5bf0 con 0x7faec813fda0 2024-06-11T17:33:29.868 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faecd0e0640 1 -- 172.21.15.130:0/2874357134 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faec813fda0 msgr2=0x7faec8140230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:29.868 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faecd0e0640 1 --2- 172.21.15.130:0/2874357134 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faec813fda0 0x7faec8140230 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 crypto rx=0x7faec0009d90 tx=0x7faec001c950 comp rx=0 tx=0).stop 2024-06-11T17:33:29.868 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faecd0e0640 1 -- 172.21.15.130:0/2874357134 shutdown_connections 2024-06-11T17:33:29.868 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faecd0e0640 1 --2- 172.21.15.130:0/2874357134 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faec813fda0 0x7faec8140230 unknown :-1 s=CLOSED pgs=2314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:29.868 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faecd0e0640 1 --2- 172.21.15.130:0/2874357134 >> v2:172.21.15.172:3300/0 conn(0x7faec806e240 0x7faec80b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:29.868 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faecd0e0640 1 -- 172.21.15.130:0/2874357134 >> 172.21.15.130:0/2874357134 conn(0x7faec80b8de0 msgr2=0x7faec80b91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:29.868 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faecd0e0640 1 -- 172.21.15.130:0/2874357134 shutdown_connections 2024-06-11T17:33:29.868 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faecd0e0640 1 -- 172.21.15.130:0/2874357134 wait complete. 2024-06-11T17:33:29.871 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faecd0e0640 1 Processor -- start 2024-06-11T17:33:29.871 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faecd0e0640 1 -- start start 2024-06-11T17:33:29.871 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faecd0e0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faec806e240 0x7faec80ac620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:29.871 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faecd0e0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faec813fda0 0x7faec81497e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:29.871 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faecd0e0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faec8146170 0x7faec8149d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:29.871 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faecd0e0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7faec81500b0 con 0x7faec8146170 2024-06-11T17:33:29.871 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faecd0e0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7faec814ff30 con 0x7faec806e240 2024-06-11T17:33:29.871 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faecd0e0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7faec8150230 con 0x7faec813fda0 2024-06-11T17:33:29.872 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faec659c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faec813fda0 0x7faec81497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:29.872 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faec759e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faec8146170 0x7faec8149d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:29.872 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faec759e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faec8146170 0x7faec8149d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:55024/0 (socket says 172.21.15.130:55024) 2024-06-11T17:33:29.872 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faec759e640 1 -- 172.21.15.130:0/2159471902 learned_addr learned my addr 172.21.15.130:0/2159471902 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:33:29.872 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faec659c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faec813fda0 0x7faec81497e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:35224/0 (socket says 172.21.15.130:35224) 2024-06-11T17:33:29.872 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faec6d9d640 1 --2- 172.21.15.130:0/2159471902 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faec806e240 0x7faec80ac620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:29.872 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faec759e640 1 -- 172.21.15.130:0/2159471902 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faec813fda0 msgr2=0x7faec81497e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:29.872 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faec759e640 1 --2- 172.21.15.130:0/2159471902 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faec813fda0 0x7faec81497e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:29.873 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faec759e640 1 -- 172.21.15.130:0/2159471902 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faec806e240 msgr2=0x7faec80ac620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:29.873 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faec759e640 1 --2- 172.21.15.130:0/2159471902 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faec806e240 0x7faec80ac620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:29.873 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faec759e640 1 -- 172.21.15.130:0/2159471902 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec80adc90 con 0x7faec8146170 2024-06-11T17:33:29.873 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faec659c640 1 --2- 172.21.15.130:0/2159471902 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faec813fda0 0x7faec81497e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:33:29.873 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faec6d9d640 1 --2- 172.21.15.130:0/2159471902 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faec806e240 0x7faec80ac620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-11T17:33:29.873 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faec759e640 1 --2- 172.21.15.130:0/2159471902 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faec8146170 0x7faec8149d20 secure :-1 s=READY pgs=4059 cs=0 l=1 rev1=1 crypto rx=0x7faec00b0040 tx=0x7faec00196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:29.873 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faeaf7fe640 1 -- 172.21.15.130:0/2159471902 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec00bd020 con 0x7faec8146170 2024-06-11T17:33:29.873 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faeaf7fe640 1 -- 172.21.15.130:0/2159471902 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faec00b3040 con 0x7faec8146170 2024-06-11T17:33:29.873 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faecd0e0640 1 -- 172.21.15.130:0/2159471902 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faec80acb60 con 0x7faec8146170 2024-06-11T17:33:29.874 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faeaf7fe640 1 -- 172.21.15.130:0/2159471902 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec00b2050 con 0x7faec8146170 2024-06-11T17:33:29.874 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.869+0000 7faecd0e0640 1 -- 172.21.15.130:0/2159471902 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faec814c400 con 0x7faec8146170 2024-06-11T17:33:29.874 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.873+0000 7faecd0e0640 1 -- 172.21.15.130:0/2159471902 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faec80b2d80 con 0x7faec8146170 2024-06-11T17:33:29.875 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.873+0000 7faeaf7fe640 1 -- 172.21.15.130:0/2159471902 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7faec00ad650 con 0x7faec8146170 2024-06-11T17:33:29.875 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.873+0000 7faeaf7fe640 1 --2- 172.21.15.130:0/2159471902 >> v2:172.21.15.130:6816/3863300924 conn(0x7faeb4070d60 0x7faeb4073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:29.875 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.873+0000 7faec6d9d640 1 --2- 172.21.15.130:0/2159471902 >> v2:172.21.15.130:6816/3863300924 conn(0x7faeb4070d60 0x7faeb4073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:29.875 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.873+0000 7faeaf7fe640 1 -- 172.21.15.130:0/2159471902 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(702..702 src has 449..702) ==== 5253+0+0 (secure 0 0 0) 0x7faec012b910 con 0x7faec8146170 2024-06-11T17:33:29.875 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.873+0000 7faec6d9d640 1 --2- 172.21.15.130:0/2159471902 >> v2:172.21.15.130:6816/3863300924 conn(0x7faeb4070d60 0x7faeb4073220 secure :-1 s=READY pgs=3446 cs=0 l=1 rev1=1 crypto rx=0x7faeb8006fd0 tx=0x7faeb8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:29.876 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:29.877+0000 7faeaf7fe640 1 -- 172.21.15.130:0/2159471902 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7faec00c7060 con 0x7faec8146170 2024-06-11T17:33:30.033 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.033+0000 7faecd0e0640 1 -- 172.21.15.130:0/2159471902 --> v2:172.21.15.130:6816/3863300924 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7faec80acd90 con 0x7faeb4070d60 2024-06-11T17:33:30.033 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.033+0000 7faeaf7fe640 1 -- 172.21.15.130:0/2159471902 <== mgr.4107 v2:172.21.15.130:6816/3863300924 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7faec80acd90 con 0x7faeb4070d60 2024-06-11T17:33:30.033 INFO:teuthology.orchestra.run.smithi130.stderr:instructed osd(s) 3 to deep-scrub 2024-06-11T17:33:30.035 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.037+0000 7faecd0e0640 1 -- 172.21.15.130:0/2159471902 >> v2:172.21.15.130:6816/3863300924 conn(0x7faeb4070d60 msgr2=0x7faeb4073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:30.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.037+0000 7faecd0e0640 1 --2- 172.21.15.130:0/2159471902 >> v2:172.21.15.130:6816/3863300924 conn(0x7faeb4070d60 0x7faeb4073220 secure :-1 s=READY pgs=3446 cs=0 l=1 rev1=1 crypto rx=0x7faeb8006fd0 tx=0x7faeb8008040 comp rx=0 tx=0).stop 2024-06-11T17:33:30.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.037+0000 7faecd0e0640 1 -- 172.21.15.130:0/2159471902 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faec8146170 msgr2=0x7faec8149d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:30.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.037+0000 7faecd0e0640 1 --2- 172.21.15.130:0/2159471902 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faec8146170 0x7faec8149d20 secure :-1 s=READY pgs=4059 cs=0 l=1 rev1=1 crypto rx=0x7faec00b0040 tx=0x7faec00196f0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.037+0000 7faecd0e0640 1 -- 172.21.15.130:0/2159471902 shutdown_connections 2024-06-11T17:33:30.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.037+0000 7faecd0e0640 1 --2- 172.21.15.130:0/2159471902 >> v2:172.21.15.130:6816/3863300924 conn(0x7faeb4070d60 0x7faeb4073220 unknown :-1 s=CLOSED pgs=3446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.037+0000 7faecd0e0640 1 --2- 172.21.15.130:0/2159471902 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faec8146170 0x7faec8149d20 unknown :-1 s=CLOSED pgs=4059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.037+0000 7faecd0e0640 1 --2- 172.21.15.130:0/2159471902 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faec813fda0 0x7faec81497e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.037 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.037+0000 7faecd0e0640 1 --2- 172.21.15.130:0/2159471902 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faec806e240 0x7faec80ac620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.037 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.037+0000 7faecd0e0640 1 -- 172.21.15.130:0/2159471902 >> 172.21.15.130:0/2159471902 conn(0x7faec80b8de0 msgr2=0x7faec8144500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:30.037 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.037+0000 7faecd0e0640 1 -- 172.21.15.130:0/2159471902 shutdown_connections 2024-06-11T17:33:30.037 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.037+0000 7faecd0e0640 1 -- 172.21.15.130:0/2159471902 wait complete. 2024-06-11T17:33:30.051 INFO:tasks.ceph:Scrubbing osd.4 2024-06-11T17:33:30.051 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-06-11T17:33:30.175 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.177+0000 7f371cb6a640 1 Processor -- start 2024-06-11T17:33:30.175 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.177+0000 7f371cb6a640 1 -- start start 2024-06-11T17:33:30.176 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.177+0000 7f371cb6a640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f371806e230 0x7f3718073e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:30.177 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.177+0000 7f371cb6a640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3718071c60 con 0x7f371806ec20 2024-06-11T17:33:30.177 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.177+0000 7f371cb6a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37181478d0 con 0x7f37180b0600 2024-06-11T17:33:30.177 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.177+0000 7f371cb6a640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f371806f000 con 0x7f371806e230 2024-06-11T17:33:30.177 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.177+0000 7f371659c640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f371806ec20 0x7f37181471c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:60834/0 (socket says 172.21.15.130:60834) 2024-06-11T17:33:30.177 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.177+0000 7f3716d9d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f371806e230 0x7f3718073e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:30.177 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.177+0000 7f371659c640 1 -- 172.21.15.130:0/3851429364 learned_addr learned my addr 172.21.15.130:0/3851429364 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-06-11T17:33:30.177 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.177+0000 7f371559a640 1 -- 172.21.15.130:0/3851429364 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3141285067 0 0) 0x7f3718071c60 con 0x7f371806ec20 2024-06-11T17:33:30.177 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.177+0000 7f371559a640 1 -- 172.21.15.130:0/3851429364 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3700003530 con 0x7f371806ec20 2024-06-11T17:33:30.178 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.177+0000 7f3716d9d640 1 -- 172.21.15.130:0/3851429364 >> v1:172.21.15.172:6789/0 conn(0x7f37180b0600 legacy=0x7f3718073730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:30.178 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.177+0000 7f3716d9d640 1 -- 172.21.15.130:0/3851429364 >> v1:172.21.15.130:6789/0 conn(0x7f371806ec20 legacy=0x7f37181471c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:30.178 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.177+0000 7f3716d9d640 1 -- 172.21.15.130:0/3851429364 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3718071ed0 con 0x7f371806e230 2024-06-11T17:33:30.179 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.181+0000 7f3716d9d640 1 --2- 172.21.15.130:0/3851429364 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f371806e230 0x7f3718073e40 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 crypto rx=0x7f37080097f0 tx=0x7f370801c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe679e528ffc1416 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:30.179 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.181+0000 7f371559a640 1 -- 172.21.15.130:0/3851429364 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37080b0070 con 0x7f371806e230 2024-06-11T17:33:30.179 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.181+0000 7f371559a640 1 -- 172.21.15.130:0/3851429364 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37080ab600 con 0x7f371806e230 2024-06-11T17:33:30.179 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.181+0000 7f371559a640 1 -- 172.21.15.130:0/3851429364 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37080ab9d0 con 0x7f371806e230 2024-06-11T17:33:30.180 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.181+0000 7f371cb6a640 1 -- 172.21.15.130:0/3851429364 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f371806e230 msgr2=0x7f3718073e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:30.180 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.181+0000 7f371cb6a640 1 --2- 172.21.15.130:0/3851429364 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f371806e230 0x7f3718073e40 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 crypto rx=0x7f37080097f0 tx=0x7f370801c4c0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.180 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.181+0000 7f371cb6a640 1 -- 172.21.15.130:0/3851429364 shutdown_connections 2024-06-11T17:33:30.180 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.181+0000 7f371cb6a640 1 --2- 172.21.15.130:0/3851429364 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f371806e230 0x7f3718073e40 unknown :-1 s=CLOSED pgs=2315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.181 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.181+0000 7f371cb6a640 1 -- 172.21.15.130:0/3851429364 >> 172.21.15.130:0/3851429364 conn(0x7f37180b6ce0 msgr2=0x7f37180b70f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:30.181 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.181+0000 7f371cb6a640 1 -- 172.21.15.130:0/3851429364 shutdown_connections 2024-06-11T17:33:30.181 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.181+0000 7f371cb6a640 1 -- 172.21.15.130:0/3851429364 wait complete. 2024-06-11T17:33:30.183 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.181+0000 7f371cb6a640 1 Processor -- start 2024-06-11T17:33:30.183 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.181+0000 7f371cb6a640 1 -- start start 2024-06-11T17:33:30.183 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.181+0000 7f371cb6a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f371806e230 0x7f3718144a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:30.183 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.181+0000 7f371cb6a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f371806ec20 0x7f3718144f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:30.183 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.181+0000 7f371cb6a640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37180b0600 0x7f371813ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:30.183 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.181+0000 7f371cb6a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f37181559c0 con 0x7f371806ec20 2024-06-11T17:33:30.184 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.181+0000 7f371cb6a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3718155840 con 0x7f371806e230 2024-06-11T17:33:30.184 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.181+0000 7f371cb6a640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f3718155b40 con 0x7f37180b0600 2024-06-11T17:33:30.184 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.181+0000 7f3715d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f371806ec20 0x7f3718144f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:30.184 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.181+0000 7f3715d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f371806ec20 0x7f3718144f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:55032/0 (socket says 172.21.15.130:55032) 2024-06-11T17:33:30.184 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.181+0000 7f3715d9b640 1 -- 172.21.15.130:0/2328409176 learned_addr learned my addr 172.21.15.130:0/2328409176 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:33:30.184 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.181+0000 7f3716d9d640 1 --2- 172.21.15.130:0/2328409176 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37180b0600 0x7f371813ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:30.184 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.181+0000 7f371659c640 1 --2- 172.21.15.130:0/2328409176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f371806e230 0x7f3718144a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:30.184 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.181+0000 7f3715d9b640 1 -- 172.21.15.130:0/2328409176 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37180b0600 msgr2=0x7f371813ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:30.185 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.181+0000 7f3715d9b640 1 --2- 172.21.15.130:0/2328409176 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37180b0600 0x7f371813ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.185 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.181+0000 7f3715d9b640 1 -- 172.21.15.130:0/2328409176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f371806e230 msgr2=0x7f3718144a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:30.185 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.181+0000 7f3715d9b640 1 --2- 172.21.15.130:0/2328409176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f371806e230 0x7f3718144a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.185 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.181+0000 7f3715d9b640 1 -- 172.21.15.130:0/2328409176 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3718145e10 con 0x7f371806ec20 2024-06-11T17:33:30.185 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.185+0000 7f3715d9b640 1 --2- 172.21.15.130:0/2328409176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f371806ec20 0x7f3718144f40 secure :-1 s=READY pgs=4061 cs=0 l=1 rev1=1 crypto rx=0x7f370c00c3c0 tx=0x7f370c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:30.185 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.185+0000 7f3706ffd640 1 -- 172.21.15.130:0/2328409176 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f370c017070 con 0x7f371806ec20 2024-06-11T17:33:30.185 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.185+0000 7f3706ffd640 1 -- 172.21.15.130:0/2328409176 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f370c0052d0 con 0x7f371806ec20 2024-06-11T17:33:30.185 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.185+0000 7f371cb6a640 1 -- 172.21.15.130:0/2328409176 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37181460f0 con 0x7f371806ec20 2024-06-11T17:33:30.186 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.185+0000 7f3706ffd640 1 -- 172.21.15.130:0/2328409176 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f370c0054c0 con 0x7f371806ec20 2024-06-11T17:33:30.186 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.185+0000 7f371cb6a640 1 -- 172.21.15.130:0/2328409176 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37181517e0 con 0x7f371806ec20 2024-06-11T17:33:30.186 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.185+0000 7f371cb6a640 1 -- 172.21.15.130:0/2328409176 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3718145540 con 0x7f371806ec20 2024-06-11T17:33:30.187 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.185+0000 7f3706ffd640 1 -- 172.21.15.130:0/2328409176 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f370c01a070 con 0x7f371806ec20 2024-06-11T17:33:30.187 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.185+0000 7f3706ffd640 1 --2- 172.21.15.130:0/2328409176 >> v2:172.21.15.130:6816/3863300924 conn(0x7f36f8070d60 0x7f36f8073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:30.187 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.185+0000 7f3706ffd640 1 -- 172.21.15.130:0/2328409176 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(702..702 src has 449..702) ==== 5253+0+0 (secure 0 0 0) 0x7f370c0907a0 con 0x7f371806ec20 2024-06-11T17:33:30.187 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.185+0000 7f371659c640 1 --2- 172.21.15.130:0/2328409176 >> v2:172.21.15.130:6816/3863300924 conn(0x7f36f8070d60 0x7f36f8073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:30.187 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.185+0000 7f3706ffd640 1 --2- 172.21.15.130:0/2328409176 >> v2:172.21.15.172:6812/1264612709 conn(0x7f36f80786e0 0x7f36f807ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:30.187 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.185+0000 7f3706ffd640 1 -- 172.21.15.130:0/2328409176 --> v2:172.21.15.172:6812/1264612709 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f370c01dec0 con 0x7f36f80786e0 2024-06-11T17:33:30.188 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.185+0000 7f3706ffd640 1 -- 172.21.15.130:0/2328409176 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_get_version_reply(handle=1 version=702) ==== 24+0+0 (secure 0 0 0) 0x7f370c090c30 con 0x7f371806ec20 2024-06-11T17:33:30.188 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.185+0000 7f371659c640 1 --2- 172.21.15.130:0/2328409176 >> v2:172.21.15.130:6816/3863300924 conn(0x7f36f8070d60 0x7f36f8073220 secure :-1 s=READY pgs=3447 cs=0 l=1 rev1=1 crypto rx=0x7f3710001810 tx=0x7f3710009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:30.188 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.185+0000 7f3716d9d640 1 --2- 172.21.15.130:0/2328409176 >> v2:172.21.15.172:6812/1264612709 conn(0x7f36f80786e0 0x7f36f807ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:30.188 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.185+0000 7f3716d9d640 1 --2- 172.21.15.130:0/2328409176 >> v2:172.21.15.172:6812/1264612709 conn(0x7f36f80786e0 0x7f36f807ab80 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:30.188 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.189+0000 7f3706ffd640 1 -- 172.21.15.130:0/2328409176 <== osd.4 v2:172.21.15.172:6812/1264612709 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f370c01dec0 con 0x7f36f80786e0 2024-06-11T17:33:30.200 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.201+0000 7f371cb6a640 1 -- 172.21.15.130:0/2328409176 --> v2:172.21.15.172:6812/1264612709 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f37181471c0 con 0x7f36f80786e0 2024-06-11T17:33:30.201 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.201+0000 7f3706ffd640 1 -- 172.21.15.130:0/2328409176 <== osd.4 v2:172.21.15.172:6812/1264612709 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f37181471c0 con 0x7f36f80786e0 2024-06-11T17:33:30.202 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-06-11T17:33:30.202 INFO:teuthology.orchestra.run.smithi130.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-11T17:33:30.202 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-06-11T17:33:30.203 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.201+0000 7f371cb6a640 1 -- 172.21.15.130:0/2328409176 >> v2:172.21.15.172:6812/1264612709 conn(0x7f36f80786e0 msgr2=0x7f36f807ab80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:30.203 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.201+0000 7f371cb6a640 1 --2- 172.21.15.130:0/2328409176 >> v2:172.21.15.172:6812/1264612709 conn(0x7f36f80786e0 0x7f36f807ab80 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.203 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.201+0000 7f371cb6a640 1 -- 172.21.15.130:0/2328409176 >> v2:172.21.15.130:6816/3863300924 conn(0x7f36f8070d60 msgr2=0x7f36f8073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:30.203 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.201+0000 7f371cb6a640 1 --2- 172.21.15.130:0/2328409176 >> v2:172.21.15.130:6816/3863300924 conn(0x7f36f8070d60 0x7f36f8073220 secure :-1 s=READY pgs=3447 cs=0 l=1 rev1=1 crypto rx=0x7f3710001810 tx=0x7f3710009040 comp rx=0 tx=0).stop 2024-06-11T17:33:30.203 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.201+0000 7f371cb6a640 1 -- 172.21.15.130:0/2328409176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f371806ec20 msgr2=0x7f3718144f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:30.203 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.201+0000 7f371cb6a640 1 --2- 172.21.15.130:0/2328409176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f371806ec20 0x7f3718144f40 secure :-1 s=READY pgs=4061 cs=0 l=1 rev1=1 crypto rx=0x7f370c00c3c0 tx=0x7f370c00c880 comp rx=0 tx=0).stop 2024-06-11T17:33:30.204 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.201+0000 7f3716d9d640 1 -- 172.21.15.130:0/2328409176 reap_dead start 2024-06-11T17:33:30.204 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.201+0000 7f371cb6a640 1 -- 172.21.15.130:0/2328409176 shutdown_connections 2024-06-11T17:33:30.204 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.201+0000 7f371cb6a640 1 -- 172.21.15.130:0/2328409176 >> 172.21.15.130:0/2328409176 conn(0x7f37180b6ce0 msgr2=0x7f37180b14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:30.204 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.201+0000 7f371cb6a640 1 -- 172.21.15.130:0/2328409176 shutdown_connections 2024-06-11T17:33:30.204 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.201+0000 7f371cb6a640 1 -- 172.21.15.130:0/2328409176 wait complete. 2024-06-11T17:33:30.218 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-06-11T17:33:30.331 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.333+0000 7f7928073640 1 Processor -- start 2024-06-11T17:33:30.332 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.333+0000 7f7928073640 1 -- start start 2024-06-11T17:33:30.333 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.333+0000 7f7928073640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f79200aca80 0x7f792013dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:30.333 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.333+0000 7f7928073640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f79201412f0 0x7f792014b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:30.333 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.333+0000 7f7928073640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79200aede0 con 0x7f792013e280 2024-06-11T17:33:30.333 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.333+0000 7f7928073640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f79200ad790 con 0x7f79200aca80 2024-06-11T17:33:30.333 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.333+0000 7f7928073640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f79200adbe0 con 0x7f79201412f0 2024-06-11T17:33:30.334 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.333+0000 7f7925e0f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f79200aca80 0x7f792013dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:30.334 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.333+0000 7f7925e0f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f79200aca80 0x7f792013dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:55036/0 (socket says 172.21.15.130:55036) 2024-06-11T17:33:30.334 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.333+0000 7f7925e0f640 1 -- 172.21.15.130:0/26712042 learned_addr learned my addr 172.21.15.130:0/26712042 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:33:30.334 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.333+0000 7f7926610640 1 --2- 172.21.15.130:0/26712042 >> v2:172.21.15.172:3300/0 conn(0x7f79201412f0 0x7f792014b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:30.334 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.333+0000 7f7925e0f640 1 -- 172.21.15.130:0/26712042 >> v2:172.21.15.172:3300/0 conn(0x7f79201412f0 msgr2=0x7f792014b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:33:30.334 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.333+0000 7f7925e0f640 1 --2- 172.21.15.130:0/26712042 >> v2:172.21.15.172:3300/0 conn(0x7f79201412f0 0x7f792014b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.334 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.333+0000 7f7925e0f640 1 -- 172.21.15.130:0/26712042 >> v1:172.21.15.130:6789/0 conn(0x7f792013e280 legacy=0x7f7920140be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:30.334 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.333+0000 7f7925e0f640 1 -- 172.21.15.130:0/26712042 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79200ad240 con 0x7f79200aca80 2024-06-11T17:33:30.341 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.337+0000 7f7925e0f640 1 --2- 172.21.15.130:0/26712042 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79200aca80 0x7f792013dd40 secure :-1 s=READY pgs=4063 cs=0 l=1 rev1=1 crypto rx=0x7f7920073b40 tx=0x7f791c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a561be30d2968259 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:30.341 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.337+0000 7f7924e0d640 1 -- 172.21.15.130:0/26712042 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c0aa5f0 con 0x7f79200aca80 2024-06-11T17:33:30.341 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.337+0000 7f7924e0d640 1 -- 172.21.15.130:0/26712042 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f791c0af070 con 0x7f79200aca80 2024-06-11T17:33:30.341 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.337+0000 7f7924e0d640 1 -- 172.21.15.130:0/26712042 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c0aa9b0 con 0x7f79200aca80 2024-06-11T17:33:30.341 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.337+0000 7f7928073640 1 -- 172.21.15.130:0/26712042 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79200aca80 msgr2=0x7f792013dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:30.341 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.337+0000 7f7928073640 1 --2- 172.21.15.130:0/26712042 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79200aca80 0x7f792013dd40 secure :-1 s=READY pgs=4063 cs=0 l=1 rev1=1 crypto rx=0x7f7920073b40 tx=0x7f791c01c470 comp rx=0 tx=0).stop 2024-06-11T17:33:30.342 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.337+0000 7f7928073640 1 -- 172.21.15.130:0/26712042 shutdown_connections 2024-06-11T17:33:30.342 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.337+0000 7f7928073640 1 --2- 172.21.15.130:0/26712042 >> v2:172.21.15.172:3300/0 conn(0x7f79201412f0 0x7f792014b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.342 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.337+0000 7f7928073640 1 --2- 172.21.15.130:0/26712042 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79200aca80 0x7f792013dd40 unknown :-1 s=CLOSED pgs=4063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.342 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.337+0000 7f7928073640 1 -- 172.21.15.130:0/26712042 >> 172.21.15.130:0/26712042 conn(0x7f79200b46b0 msgr2=0x7f79200b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:30.342 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.337+0000 7f7928073640 1 -- 172.21.15.130:0/26712042 shutdown_connections 2024-06-11T17:33:30.342 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.337+0000 7f7928073640 1 -- 172.21.15.130:0/26712042 wait complete. 2024-06-11T17:33:30.342 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.337+0000 7f7928073640 1 Processor -- start 2024-06-11T17:33:30.342 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.337+0000 7f7928073640 1 -- start start 2024-06-11T17:33:30.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.341+0000 7f7928073640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f79200aca80 0x7f79200ab0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:30.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.341+0000 7f7928073640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f792013e280 0x7f7920144530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:30.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.341+0000 7f7928073640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79201412f0 0x7f79201db0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:30.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.341+0000 7f7928073640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f792014df30 con 0x7f792013e280 2024-06-11T17:33:30.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.341+0000 7f7928073640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7920073dc0 con 0x7f79201412f0 2024-06-11T17:33:30.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.341+0000 7f7928073640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f792014e0b0 con 0x7f79200aca80 2024-06-11T17:33:30.344 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.341+0000 7f7925e0f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f79200aca80 0x7f79200ab0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:30.344 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.341+0000 7f792560e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f792013e280 0x7f7920144530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:30.344 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.341+0000 7f792560e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f792013e280 0x7f7920144530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:55040/0 (socket says 172.21.15.130:55040) 2024-06-11T17:33:30.344 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.341+0000 7f7925e0f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f79200aca80 0x7f79200ab0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:35266/0 (socket says 172.21.15.130:35266) 2024-06-11T17:33:30.344 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.341+0000 7f792560e640 1 -- 172.21.15.130:0/743656283 learned_addr learned my addr 172.21.15.130:0/743656283 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:33:30.344 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.341+0000 7f7926610640 1 --2- 172.21.15.130:0/743656283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79201412f0 0x7f79201db0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:30.344 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.341+0000 7f7925e0f640 1 -- 172.21.15.130:0/743656283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79201412f0 msgr2=0x7f79201db0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:30.344 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.341+0000 7f7925e0f640 1 --2- 172.21.15.130:0/743656283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79201412f0 0x7f79201db0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.345 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.341+0000 7f7925e0f640 1 -- 172.21.15.130:0/743656283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f792013e280 msgr2=0x7f7920144530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:30.345 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.341+0000 7f7925e0f640 1 --2- 172.21.15.130:0/743656283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f792013e280 0x7f7920144530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.345 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.341+0000 7f7925e0f640 1 -- 172.21.15.130:0/743656283 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7920144a70 con 0x7f79200aca80 2024-06-11T17:33:30.345 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.341+0000 7f7925e0f640 1 --2- 172.21.15.130:0/743656283 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f79200aca80 0x7f79200ab0c0 secure :-1 s=READY pgs=2316 cs=0 l=1 rev1=1 crypto rx=0x7f791c0ab000 tx=0x7f791c01acb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:30.345 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.341+0000 7f79167fc640 1 -- 172.21.15.130:0/743656283 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c0bd5f0 con 0x7f79200aca80 2024-06-11T17:33:30.345 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.341+0000 7f79167fc640 1 -- 172.21.15.130:0/743656283 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f791c0bd7b0 con 0x7f79200aca80 2024-06-11T17:33:30.345 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.341+0000 7f7928073640 1 -- 172.21.15.130:0/743656283 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79201dac10 con 0x7f79200aca80 2024-06-11T17:33:30.345 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.341+0000 7f79167fc640 1 -- 172.21.15.130:0/743656283 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c0bdba0 con 0x7f79200aca80 2024-06-11T17:33:30.345 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.341+0000 7f7928073640 1 -- 172.21.15.130:0/743656283 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f79201db600 con 0x7f79200aca80 2024-06-11T17:33:30.346 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.341+0000 7f7928073640 1 -- 172.21.15.130:0/743656283 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f792013dd40 con 0x7f79200aca80 2024-06-11T17:33:30.346 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.341+0000 7f79167fc640 1 -- 172.21.15.130:0/743656283 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f791c0b33f0 con 0x7f79200aca80 2024-06-11T17:33:30.346 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.341+0000 7f79167fc640 1 --2- 172.21.15.130:0/743656283 >> v2:172.21.15.130:6816/3863300924 conn(0x7f7904070d60 0x7f7904073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:30.347 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.341+0000 7f79167fc640 1 -- 172.21.15.130:0/743656283 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(702..702 src has 449..702) ==== 5253+0+0 (secure 0 0 0) 0x7f791c12b970 con 0x7f79200aca80 2024-06-11T17:33:30.347 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.341+0000 7f792560e640 1 --2- 172.21.15.130:0/743656283 >> v2:172.21.15.130:6816/3863300924 conn(0x7f7904070d60 0x7f7904073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:30.347 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.341+0000 7f792560e640 1 --2- 172.21.15.130:0/743656283 >> v2:172.21.15.130:6816/3863300924 conn(0x7f7904070d60 0x7f7904073220 secure :-1 s=READY pgs=3448 cs=0 l=1 rev1=1 crypto rx=0x7f79200aa850 tx=0x7f7910009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:30.347 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.345+0000 7f79167fc640 1 -- 172.21.15.130:0/743656283 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7f791c0160f0 con 0x7f79200aca80 2024-06-11T17:33:30.511 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.513+0000 7f7928073640 1 -- 172.21.15.130:0/743656283 --> v2:172.21.15.130:6816/3863300924 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f7920142d20 con 0x7f7904070d60 2024-06-11T17:33:30.512 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.513+0000 7f79167fc640 1 -- 172.21.15.130:0/743656283 <== mgr.4107 v2:172.21.15.130:6816/3863300924 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7920142d20 con 0x7f7904070d60 2024-06-11T17:33:30.512 INFO:teuthology.orchestra.run.smithi130.stderr:instructed osd(s) 4 to deep-scrub 2024-06-11T17:33:30.514 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.517+0000 7f7928073640 1 -- 172.21.15.130:0/743656283 >> v2:172.21.15.130:6816/3863300924 conn(0x7f7904070d60 msgr2=0x7f7904073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:30.514 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.517+0000 7f7928073640 1 --2- 172.21.15.130:0/743656283 >> v2:172.21.15.130:6816/3863300924 conn(0x7f7904070d60 0x7f7904073220 secure :-1 s=READY pgs=3448 cs=0 l=1 rev1=1 crypto rx=0x7f79200aa850 tx=0x7f7910009040 comp rx=0 tx=0).stop 2024-06-11T17:33:30.515 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.517+0000 7f7928073640 1 -- 172.21.15.130:0/743656283 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f79200aca80 msgr2=0x7f79200ab0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:30.515 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.517+0000 7f7928073640 1 --2- 172.21.15.130:0/743656283 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f79200aca80 0x7f79200ab0c0 secure :-1 s=READY pgs=2316 cs=0 l=1 rev1=1 crypto rx=0x7f791c0ab000 tx=0x7f791c01acb0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.515 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.517+0000 7f7928073640 1 -- 172.21.15.130:0/743656283 shutdown_connections 2024-06-11T17:33:30.515 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.517+0000 7f7928073640 1 --2- 172.21.15.130:0/743656283 >> v2:172.21.15.130:6816/3863300924 conn(0x7f7904070d60 0x7f7904073220 unknown :-1 s=CLOSED pgs=3448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.515 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.517+0000 7f7928073640 1 --2- 172.21.15.130:0/743656283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79201412f0 0x7f79201db0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.515 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.517+0000 7f7928073640 1 --2- 172.21.15.130:0/743656283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f792013e280 0x7f7920144530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.515 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.517+0000 7f7928073640 1 --2- 172.21.15.130:0/743656283 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f79200aca80 0x7f79200ab0c0 unknown :-1 s=CLOSED pgs=2316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.515 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.517+0000 7f7928073640 1 -- 172.21.15.130:0/743656283 >> 172.21.15.130:0/743656283 conn(0x7f79200b46b0 msgr2=0x7f79200aefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:30.515 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.517+0000 7f7928073640 1 -- 172.21.15.130:0/743656283 shutdown_connections 2024-06-11T17:33:30.516 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.517+0000 7f7928073640 1 -- 172.21.15.130:0/743656283 wait complete. 2024-06-11T17:33:30.531 INFO:tasks.ceph:Scrubbing osd.5 2024-06-11T17:33:30.531 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-06-11T17:33:30.657 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.657+0000 7f57586d2640 1 Processor -- start 2024-06-11T17:33:30.657 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.657+0000 7f57586d2640 1 -- start start 2024-06-11T17:33:30.660 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.657+0000 7f57586d2640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f57500710e0 0x7f57500b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:30.660 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.657+0000 7f57586d2640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57500b3090 con 0x7f5750073d10 2024-06-11T17:33:30.660 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.657+0000 7f57586d2640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57500738f0 con 0x7f57500714c0 2024-06-11T17:33:30.660 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.657+0000 7f57586d2640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f5750071950 con 0x7f57500710e0 2024-06-11T17:33:30.660 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.661+0000 7f5755c6d640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f5750073d10 0x7f5750140970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:60852/0 (socket says 172.21.15.130:60852) 2024-06-11T17:33:30.660 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.661+0000 7f5755c6d640 1 -- 172.21.15.130:0/2791864710 learned_addr learned my addr 172.21.15.130:0/2791864710 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-06-11T17:33:30.661 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.661+0000 7f575546c640 1 -- 172.21.15.130:0/2791864710 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 874676758 0 0) 0x7f57500b3090 con 0x7f5750073d10 2024-06-11T17:33:30.661 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.661+0000 7f575546c640 1 -- 172.21.15.130:0/2791864710 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f573c003530 con 0x7f5750073d10 2024-06-11T17:33:30.661 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.661+0000 7f575646e640 1 --2- 172.21.15.130:0/2791864710 >> v2:172.21.15.172:3300/0 conn(0x7f57500710e0 0x7f57500b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:30.661 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.661+0000 7f575546c640 1 -- 172.21.15.130:0/2791864710 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 834063959 0 0) 0x7f573c003530 con 0x7f5750073d10 2024-06-11T17:33:30.661 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.661+0000 7f575546c640 1 -- 172.21.15.130:0/2791864710 >> v2:172.21.15.172:3300/0 conn(0x7f57500710e0 msgr2=0x7f57500b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:33:30.661 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.661+0000 7f575546c640 1 --2- 172.21.15.130:0/2791864710 >> v2:172.21.15.172:3300/0 conn(0x7f57500710e0 0x7f57500b07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.661 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.661+0000 7f575546c640 1 -- 172.21.15.130:0/2791864710 >> v1:172.21.15.172:6789/0 conn(0x7f57500714c0 legacy=0x7f5750141080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:30.661 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.661+0000 7f575546c640 1 -- 172.21.15.130:0/2791864710 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f575013e3d0 con 0x7f5750073d10 2024-06-11T17:33:30.662 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.661+0000 7f575546c640 1 -- 172.21.15.130:0/2791864710 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3158545239 0 0) 0x7f5740001700 con 0x7f5750073d10 2024-06-11T17:33:30.662 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.661+0000 7f575546c640 1 -- 172.21.15.130:0/2791864710 >> v1:172.21.15.130:6789/0 conn(0x7f5750073d10 legacy=0x7f5750140970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:30.662 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.661+0000 7f575546c640 1 --2- 172.21.15.130:0/2791864710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f573c003a60 0x7f573c003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:30.662 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.661+0000 7f575546c640 1 --2- 172.21.15.130:0/2791864710 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f573c004810 0x7f573c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:30.662 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.661+0000 7f575546c640 1 --2- 172.21.15.130:0/2791864710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f573c0053d0 0x7f573c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:30.662 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.661+0000 7f575546c640 1 -- 172.21.15.130:0/2791864710 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5750071950 con 0x7f573c003a60 2024-06-11T17:33:30.662 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.661+0000 7f575546c640 1 -- 172.21.15.130:0/2791864710 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f573c00c240 con 0x7f573c0053d0 2024-06-11T17:33:30.662 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.661+0000 7f575546c640 1 -- 172.21.15.130:0/2791864710 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f573c00c440 con 0x7f573c004810 2024-06-11T17:33:30.662 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.661+0000 7f575646e640 1 --2- 172.21.15.130:0/2791864710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f573c003a60 0x7f573c003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:30.663 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.661+0000 7f5755c6d640 1 --2- 172.21.15.130:0/2791864710 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f573c004810 0x7f573c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:30.663 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.661+0000 7f5756c6f640 1 --2- 172.21.15.130:0/2791864710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f573c0053d0 0x7f573c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:30.663 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.661+0000 7f575646e640 1 -- 172.21.15.130:0/2791864710 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f573c004810 msgr2=0x7f573c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:33:30.663 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.661+0000 7f575646e640 1 --2- 172.21.15.130:0/2791864710 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f573c004810 0x7f573c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.663 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.661+0000 7f575646e640 1 -- 172.21.15.130:0/2791864710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f573c0053d0 msgr2=0x7f573c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:33:30.663 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.661+0000 7f575646e640 1 --2- 172.21.15.130:0/2791864710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f573c0053d0 0x7f573c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.663 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.661+0000 7f575646e640 1 -- 172.21.15.130:0/2791864710 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f573c003530 con 0x7f573c003a60 2024-06-11T17:33:30.663 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.661+0000 7f5756c6f640 1 -- 172.21.15.130:0/2791864710 reap_dead start 2024-06-11T17:33:30.667 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.661+0000 7f575646e640 1 --2- 172.21.15.130:0/2791864710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f573c003a60 0x7f573c003e80 secure :-1 s=READY pgs=4065 cs=0 l=1 rev1=1 crypto rx=0x7f574c009ae0 tx=0x7f574c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3585fd41098fb07 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:30.667 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.661+0000 7f575546c640 1 -- 172.21.15.130:0/2791864710 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c0b2070 con 0x7f573c003a60 2024-06-11T17:33:30.667 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.661+0000 7f575546c640 1 -- 172.21.15.130:0/2791864710 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f574c0a5640 con 0x7f573c003a60 2024-06-11T17:33:30.667 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.661+0000 7f575546c640 1 -- 172.21.15.130:0/2791864710 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c0096b0 con 0x7f573c003a60 2024-06-11T17:33:30.667 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.661+0000 7f57586d2640 1 -- 172.21.15.130:0/2791864710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f573c003a60 msgr2=0x7f573c003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:30.667 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.661+0000 7f57586d2640 1 --2- 172.21.15.130:0/2791864710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f573c003a60 0x7f573c003e80 secure :-1 s=READY pgs=4065 cs=0 l=1 rev1=1 crypto rx=0x7f574c009ae0 tx=0x7f574c01ca50 comp rx=0 tx=0).stop 2024-06-11T17:33:30.668 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.665+0000 7f57586d2640 1 -- 172.21.15.130:0/2791864710 shutdown_connections 2024-06-11T17:33:30.668 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.665+0000 7f57586d2640 1 --2- 172.21.15.130:0/2791864710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f573c003a60 0x7f573c003e80 unknown :-1 s=CLOSED pgs=4065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.668 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.665+0000 7f57586d2640 1 -- 172.21.15.130:0/2791864710 >> 172.21.15.130:0/2791864710 conn(0x7f57500b69b0 msgr2=0x7f57500b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:30.668 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.665+0000 7f57586d2640 1 -- 172.21.15.130:0/2791864710 shutdown_connections 2024-06-11T17:33:30.668 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.665+0000 7f57586d2640 1 -- 172.21.15.130:0/2791864710 wait complete. 2024-06-11T17:33:30.668 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.665+0000 7f57586d2640 1 Processor -- start 2024-06-11T17:33:30.668 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.665+0000 7f57586d2640 1 -- start start 2024-06-11T17:33:30.668 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.665+0000 7f57586d2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f573c003a60 0x7f575006eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:30.669 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.665+0000 7f57586d2640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f575006d310 0x7f57501de9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:30.669 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.665+0000 7f57586d2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57501cf0f0 0x7f57501cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:30.669 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.665+0000 7f57586d2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5750141510 con 0x7f57501cf0f0 2024-06-11T17:33:30.669 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.665+0000 7f57586d2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5750141390 con 0x7f573c003a60 2024-06-11T17:33:30.669 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.665+0000 7f57586d2640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f5750143e10 con 0x7f575006d310 2024-06-11T17:33:30.669 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.665+0000 7f5755c6d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f575006d310 0x7f57501de9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:30.669 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.665+0000 7f5756c6f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57501cf0f0 0x7f57501cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:30.669 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.665+0000 7f5755c6d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f575006d310 0x7f57501de9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:35272/0 (socket says 172.21.15.130:35272) 2024-06-11T17:33:30.669 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.665+0000 7f5755c6d640 1 -- 172.21.15.130:0/2509205341 learned_addr learned my addr 172.21.15.130:0/2509205341 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:33:30.670 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.665+0000 7f575646e640 1 --2- 172.21.15.130:0/2509205341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f573c003a60 0x7f575006eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:30.670 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.665+0000 7f5755c6d640 1 -- 172.21.15.130:0/2509205341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f573c003a60 msgr2=0x7f575006eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:30.670 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.665+0000 7f5755c6d640 1 --2- 172.21.15.130:0/2509205341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f573c003a60 0x7f575006eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.670 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.665+0000 7f5755c6d640 1 -- 172.21.15.130:0/2509205341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57501cf0f0 msgr2=0x7f57501cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:30.670 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.665+0000 7f5755c6d640 1 --2- 172.21.15.130:0/2509205341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57501cf0f0 0x7f57501cf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.670 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.665+0000 7f5755c6d640 1 -- 172.21.15.130:0/2509205341 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f575006e190 con 0x7f575006d310 2024-06-11T17:33:30.670 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.665+0000 7f5756c6f640 1 --2- 172.21.15.130:0/2509205341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57501cf0f0 0x7f57501cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:33:30.670 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.665+0000 7f575646e640 1 --2- 172.21.15.130:0/2509205341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f573c003a60 0x7f575006eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-11T17:33:30.671 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.665+0000 7f5755c6d640 1 --2- 172.21.15.130:0/2509205341 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f575006d310 0x7f57501de9d0 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7f5740007fd0 tx=0x7f5740007720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:30.671 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.665+0000 7f5746ffd640 1 -- 172.21.15.130:0/2509205341 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574000f9c0 con 0x7f575006d310 2024-06-11T17:33:30.671 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.665+0000 7f5746ffd640 1 -- 172.21.15.130:0/2509205341 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5740018070 con 0x7f575006d310 2024-06-11T17:33:30.671 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.665+0000 7f57586d2640 1 -- 172.21.15.130:0/2509205341 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f575006e470 con 0x7f575006d310 2024-06-11T17:33:30.671 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.665+0000 7f5746ffd640 1 -- 172.21.15.130:0/2509205341 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574000fda0 con 0x7f575006d310 2024-06-11T17:33:30.671 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.665+0000 7f57586d2640 1 -- 172.21.15.130:0/2509205341 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f57501cfc50 con 0x7f575006d310 2024-06-11T17:33:30.671 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.665+0000 7f57586d2640 1 -- 172.21.15.130:0/2509205341 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f57501441a0 con 0x7f575006d310 2024-06-11T17:33:30.671 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.669+0000 7f5746ffd640 1 -- 172.21.15.130:0/2509205341 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f574001d460 con 0x7f575006d310 2024-06-11T17:33:30.671 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.669+0000 7f5746ffd640 1 --2- 172.21.15.130:0/2509205341 >> v2:172.21.15.130:6816/3863300924 conn(0x7f5734070d90 0x7f5734073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:30.672 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.669+0000 7f5746ffd640 1 -- 172.21.15.130:0/2509205341 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(702..702 src has 449..702) ==== 5253+0+0 (secure 0 0 0) 0x7f5740091860 con 0x7f575006d310 2024-06-11T17:33:30.672 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.669+0000 7f575646e640 1 --2- 172.21.15.130:0/2509205341 >> v2:172.21.15.130:6816/3863300924 conn(0x7f5734070d90 0x7f5734073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:30.672 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.669+0000 7f5746ffd640 1 --2- 172.21.15.130:0/2509205341 >> v2:172.21.15.172:6800/63774775 conn(0x7f57340786b0 0x7f573407ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:30.672 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.669+0000 7f5746ffd640 1 -- 172.21.15.130:0/2509205341 --> v2:172.21.15.172:6800/63774775 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f573407b1e0 con 0x7f57340786b0 2024-06-11T17:33:30.672 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.669+0000 7f5746ffd640 1 -- 172.21.15.130:0/2509205341 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_get_version_reply(handle=1 version=702) ==== 24+0+0 (secure 0 0 0) 0x7f5740091cf0 con 0x7f575006d310 2024-06-11T17:33:30.672 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.669+0000 7f575646e640 1 --2- 172.21.15.130:0/2509205341 >> v2:172.21.15.130:6816/3863300924 conn(0x7f5734070d90 0x7f5734073250 secure :-1 s=READY pgs=3449 cs=0 l=1 rev1=1 crypto rx=0x7f574c0af000 tx=0x7f574c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:30.672 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.669+0000 7f5756c6f640 1 --2- 172.21.15.130:0/2509205341 >> v2:172.21.15.172:6800/63774775 conn(0x7f57340786b0 0x7f573407ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:30.673 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.669+0000 7f5756c6f640 1 --2- 172.21.15.130:0/2509205341 >> v2:172.21.15.172:6800/63774775 conn(0x7f57340786b0 0x7f573407ab50 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:30.673 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.669+0000 7f5746ffd640 1 -- 172.21.15.130:0/2509205341 <== osd.5 v2:172.21.15.172:6800/63774775 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f573407b1e0 con 0x7f57340786b0 2024-06-11T17:33:30.681 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.681+0000 7f57586d2640 1 -- 172.21.15.130:0/2509205341 --> v2:172.21.15.172:6800/63774775 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5750143be0 con 0x7f57340786b0 2024-06-11T17:33:30.682 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.685+0000 7f5746ffd640 1 -- 172.21.15.130:0/2509205341 <== osd.5 v2:172.21.15.172:6800/63774775 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5750143be0 con 0x7f57340786b0 2024-06-11T17:33:30.682 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-06-11T17:33:30.683 INFO:teuthology.orchestra.run.smithi130.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-11T17:33:30.683 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-06-11T17:33:30.684 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.685+0000 7f57586d2640 1 -- 172.21.15.130:0/2509205341 >> v2:172.21.15.172:6800/63774775 conn(0x7f57340786b0 msgr2=0x7f573407ab50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:30.684 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.685+0000 7f57586d2640 1 --2- 172.21.15.130:0/2509205341 >> v2:172.21.15.172:6800/63774775 conn(0x7f57340786b0 0x7f573407ab50 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.684 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.685+0000 7f57586d2640 1 -- 172.21.15.130:0/2509205341 >> v2:172.21.15.130:6816/3863300924 conn(0x7f5734070d90 msgr2=0x7f5734073250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:30.684 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.685+0000 7f57586d2640 1 --2- 172.21.15.130:0/2509205341 >> v2:172.21.15.130:6816/3863300924 conn(0x7f5734070d90 0x7f5734073250 secure :-1 s=READY pgs=3449 cs=0 l=1 rev1=1 crypto rx=0x7f574c0af000 tx=0x7f574c008040 comp rx=0 tx=0).stop 2024-06-11T17:33:30.684 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.685+0000 7f57586d2640 1 -- 172.21.15.130:0/2509205341 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f575006d310 msgr2=0x7f57501de9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:30.684 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.685+0000 7f57586d2640 1 --2- 172.21.15.130:0/2509205341 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f575006d310 0x7f57501de9d0 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7f5740007fd0 tx=0x7f5740007720 comp rx=0 tx=0).stop 2024-06-11T17:33:30.684 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.685+0000 7f5756c6f640 1 -- 172.21.15.130:0/2509205341 reap_dead start 2024-06-11T17:33:30.685 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.685+0000 7f57586d2640 1 -- 172.21.15.130:0/2509205341 shutdown_connections 2024-06-11T17:33:30.685 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.685+0000 7f57586d2640 1 -- 172.21.15.130:0/2509205341 >> 172.21.15.130:0/2509205341 conn(0x7f57500b69b0 msgr2=0x7f5750133c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:30.685 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.685+0000 7f57586d2640 1 -- 172.21.15.130:0/2509205341 shutdown_connections 2024-06-11T17:33:30.685 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.685+0000 7f57586d2640 1 -- 172.21.15.130:0/2509205341 wait complete. 2024-06-11T17:33:30.697 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-06-11T17:33:30.803 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.805+0000 7f1a30667640 1 Processor -- start 2024-06-11T17:33:30.804 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.805+0000 7f1a30667640 1 -- start start 2024-06-11T17:33:30.805 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.805+0000 7f1a30667640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1a280aca80 0x7f1a2813dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:30.805 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.805+0000 7f1a30667640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a281412f0 0x7f1a2814b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:30.805 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.805+0000 7f1a30667640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a280aede0 con 0x7f1a2813e280 2024-06-11T17:33:30.805 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.805+0000 7f1a30667640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f1a280ad790 con 0x7f1a280aca80 2024-06-11T17:33:30.805 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.805+0000 7f1a30667640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f1a280adbe0 con 0x7f1a281412f0 2024-06-11T17:33:30.805 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.805+0000 7f1a2e403640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1a280aca80 0x7f1a2813dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:30.806 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.805+0000 7f1a2ec04640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a281412f0 0x7f1a2814b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:30.806 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.805+0000 7f1a2e403640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1a280aca80 0x7f1a2813dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:55058/0 (socket says 172.21.15.130:55058) 2024-06-11T17:33:30.806 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.805+0000 7f1a2ec04640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a281412f0 0x7f1a2814b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:35282/0 (socket says 172.21.15.130:35282) 2024-06-11T17:33:30.806 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.805+0000 7f1a2e403640 1 -- 172.21.15.130:0/2229880275 learned_addr learned my addr 172.21.15.130:0/2229880275 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:33:30.806 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.805+0000 7f1a2e403640 1 -- 172.21.15.130:0/2229880275 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a281412f0 msgr2=0x7f1a2814b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:33:30.806 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.805+0000 7f1a2e403640 1 --2- 172.21.15.130:0/2229880275 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a281412f0 0x7f1a2814b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.806 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.805+0000 7f1a2e403640 1 -- 172.21.15.130:0/2229880275 >> v1:172.21.15.172:6789/0 conn(0x7f1a2813e280 legacy=0x7f1a28140be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:33:30.806 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.805+0000 7f1a2e403640 1 -- 172.21.15.130:0/2229880275 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a280ad240 con 0x7f1a280aca80 2024-06-11T17:33:30.807 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.805+0000 7f1a2ec04640 1 --2- 172.21.15.130:0/2229880275 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a281412f0 0x7f1a2814b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:33:30.808 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a2e403640 1 --2- 172.21.15.130:0/2229880275 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a280aca80 0x7f1a2813dd40 secure :-1 s=READY pgs=4066 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009870 tx=0x7f1a1c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=362ce240a0c12303 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:30.808 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a2d401640 1 -- 172.21.15.130:0/2229880275 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c0ab650 con 0x7f1a280aca80 2024-06-11T17:33:30.808 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a2d401640 1 -- 172.21.15.130:0/2229880275 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a1c0b0070 con 0x7f1a280aca80 2024-06-11T17:33:30.808 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a2d401640 1 -- 172.21.15.130:0/2229880275 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c0aba10 con 0x7f1a280aca80 2024-06-11T17:33:30.808 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a30667640 1 -- 172.21.15.130:0/2229880275 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a280aca80 msgr2=0x7f1a2813dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:30.808 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a30667640 1 --2- 172.21.15.130:0/2229880275 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a280aca80 0x7f1a2813dd40 secure :-1 s=READY pgs=4066 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009870 tx=0x7f1a1c01c4b0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.808 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a30667640 1 -- 172.21.15.130:0/2229880275 shutdown_connections 2024-06-11T17:33:30.809 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a30667640 1 --2- 172.21.15.130:0/2229880275 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a281412f0 0x7f1a2814b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.809 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a30667640 1 --2- 172.21.15.130:0/2229880275 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a280aca80 0x7f1a2813dd40 unknown :-1 s=CLOSED pgs=4066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.809 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a30667640 1 -- 172.21.15.130:0/2229880275 >> 172.21.15.130:0/2229880275 conn(0x7f1a280b46b0 msgr2=0x7f1a280b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:30.809 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a30667640 1 -- 172.21.15.130:0/2229880275 shutdown_connections 2024-06-11T17:33:30.809 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a30667640 1 -- 172.21.15.130:0/2229880275 wait complete. 2024-06-11T17:33:30.811 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a30667640 1 Processor -- start 2024-06-11T17:33:30.811 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a30667640 1 -- start start 2024-06-11T17:33:30.811 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a30667640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a280aca80 0x7f1a28144410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:30.812 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a30667640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a2813e280 0x7f1a280ab150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:30.812 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a30667640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a281412f0 0x7f1a280ab690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:30.812 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a30667640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2814df30 con 0x7f1a281412f0 2024-06-11T17:33:30.812 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a30667640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1a28073dc0 con 0x7f1a2813e280 2024-06-11T17:33:30.812 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a30667640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f1a2814e0b0 con 0x7f1a280aca80 2024-06-11T17:33:30.812 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a2e403640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a280aca80 0x7f1a28144410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:30.812 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a2e403640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a280aca80 0x7f1a28144410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:35294/0 (socket says 172.21.15.130:35294) 2024-06-11T17:33:30.812 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a2ec04640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a281412f0 0x7f1a280ab690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:30.812 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a2e403640 1 -- 172.21.15.130:0/196862138 learned_addr learned my addr 172.21.15.130:0/196862138 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:33:30.813 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a2e403640 1 -- 172.21.15.130:0/196862138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a2813e280 msgr2=0x7f1a280ab150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:30.813 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a2e403640 1 --2- 172.21.15.130:0/196862138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a2813e280 0x7f1a280ab150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.813 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a2e403640 1 -- 172.21.15.130:0/196862138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a281412f0 msgr2=0x7f1a280ab690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:30.813 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a2e403640 1 --2- 172.21.15.130:0/196862138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a281412f0 0x7f1a280ab690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.813 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a2e403640 1 -- 172.21.15.130:0/196862138 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a280b2c70 con 0x7f1a280aca80 2024-06-11T17:33:30.813 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a2e403640 1 --2- 172.21.15.130:0/196862138 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a280aca80 0x7f1a28144410 secure :-1 s=READY pgs=2318 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0ad040 tx=0x7f1a1c01acf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:30.813 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a1affd640 1 -- 172.21.15.130:0/196862138 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c0be5f0 con 0x7f1a280aca80 2024-06-11T17:33:30.813 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a30667640 1 -- 172.21.15.130:0/196862138 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a281436d0 con 0x7f1a280aca80 2024-06-11T17:33:30.814 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a1affd640 1 -- 172.21.15.130:0/196862138 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a1c0be7b0 con 0x7f1a280aca80 2024-06-11T17:33:30.814 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a1affd640 1 -- 172.21.15.130:0/196862138 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c0beba0 con 0x7f1a280aca80 2024-06-11T17:33:30.814 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.809+0000 7f1a30667640 1 -- 172.21.15.130:0/196862138 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a28143c90 con 0x7f1a280aca80 2024-06-11T17:33:30.814 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.813+0000 7f1a30667640 1 -- 172.21.15.130:0/196862138 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a2813dd40 con 0x7f1a280aca80 2024-06-11T17:33:30.814 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.813+0000 7f1a1affd640 1 -- 172.21.15.130:0/196862138 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f1a1c0b43f0 con 0x7f1a280aca80 2024-06-11T17:33:30.815 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.813+0000 7f1a1affd640 1 --2- 172.21.15.130:0/196862138 >> v2:172.21.15.130:6816/3863300924 conn(0x7f1a0c070d90 0x7f1a0c073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:30.815 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.813+0000 7f1a1affd640 1 -- 172.21.15.130:0/196862138 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(702..702 src has 449..702) ==== 5253+0+0 (secure 0 0 0) 0x7f1a1c12bc00 con 0x7f1a280aca80 2024-06-11T17:33:30.815 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.813+0000 7f1a2dc02640 1 --2- 172.21.15.130:0/196862138 >> v2:172.21.15.130:6816/3863300924 conn(0x7f1a0c070d90 0x7f1a0c073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:30.815 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.813+0000 7f1a2dc02640 1 --2- 172.21.15.130:0/196862138 >> v2:172.21.15.130:6816/3863300924 conn(0x7f1a0c070d90 0x7f1a0c073250 secure :-1 s=READY pgs=3450 cs=0 l=1 rev1=1 crypto rx=0x7f1a28073390 tx=0x7f1a240079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:30.816 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.817+0000 7f1a1affd640 1 -- 172.21.15.130:0/196862138 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7f1a1c132080 con 0x7f1a280aca80 2024-06-11T17:33:30.970 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.973+0000 7f1a30667640 1 -- 172.21.15.130:0/196862138 --> v2:172.21.15.130:6816/3863300924 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f1a28144950 con 0x7f1a0c070d90 2024-06-11T17:33:30.971 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.973+0000 7f1a1affd640 1 -- 172.21.15.130:0/196862138 <== mgr.4107 v2:172.21.15.130:6816/3863300924 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1a28144950 con 0x7f1a0c070d90 2024-06-11T17:33:30.971 INFO:teuthology.orchestra.run.smithi130.stderr:instructed osd(s) 5 to deep-scrub 2024-06-11T17:33:30.973 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.973+0000 7f1a30667640 1 -- 172.21.15.130:0/196862138 >> v2:172.21.15.130:6816/3863300924 conn(0x7f1a0c070d90 msgr2=0x7f1a0c073250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:30.974 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.973+0000 7f1a30667640 1 --2- 172.21.15.130:0/196862138 >> v2:172.21.15.130:6816/3863300924 conn(0x7f1a0c070d90 0x7f1a0c073250 secure :-1 s=READY pgs=3450 cs=0 l=1 rev1=1 crypto rx=0x7f1a28073390 tx=0x7f1a240079c0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.974 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.973+0000 7f1a30667640 1 -- 172.21.15.130:0/196862138 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a280aca80 msgr2=0x7f1a28144410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:30.974 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.973+0000 7f1a30667640 1 --2- 172.21.15.130:0/196862138 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a280aca80 0x7f1a28144410 secure :-1 s=READY pgs=2318 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0ad040 tx=0x7f1a1c01acf0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.974 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.973+0000 7f1a30667640 1 -- 172.21.15.130:0/196862138 shutdown_connections 2024-06-11T17:33:30.974 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.973+0000 7f1a30667640 1 --2- 172.21.15.130:0/196862138 >> v2:172.21.15.130:6816/3863300924 conn(0x7f1a0c070d90 0x7f1a0c073250 unknown :-1 s=CLOSED pgs=3450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.974 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.973+0000 7f1a30667640 1 --2- 172.21.15.130:0/196862138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a281412f0 0x7f1a280ab690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.974 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.973+0000 7f1a30667640 1 --2- 172.21.15.130:0/196862138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a2813e280 0x7f1a280ab150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.974 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.973+0000 7f1a30667640 1 --2- 172.21.15.130:0/196862138 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a280aca80 0x7f1a28144410 unknown :-1 s=CLOSED pgs=2318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:30.975 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.973+0000 7f1a30667640 1 -- 172.21.15.130:0/196862138 >> 172.21.15.130:0/196862138 conn(0x7f1a280b46b0 msgr2=0x7f1a280b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:30.975 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.973+0000 7f1a30667640 1 -- 172.21.15.130:0/196862138 shutdown_connections 2024-06-11T17:33:30.975 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:30.973+0000 7f1a30667640 1 -- 172.21.15.130:0/196862138 wait complete. 2024-06-11T17:33:30.989 INFO:tasks.ceph:Scrubbing osd.6 2024-06-11T17:33:30.989 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-06-11T17:33:31.103 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.105+0000 7fe8ac17a640 1 Processor -- start 2024-06-11T17:33:31.104 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.105+0000 7fe8ac17a640 1 -- start start 2024-06-11T17:33:31.105 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.105+0000 7fe8ac17a640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe8a414c3e0 0x7fe8a414e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:31.105 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.105+0000 7fe8ac17a640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8a40af240 con 0x7fe8a41462b0 2024-06-11T17:33:31.105 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.105+0000 7fe8ac17a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8a4140680 con 0x7fe8a406dba0 2024-06-11T17:33:31.105 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.105+0000 7fe8ac17a640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fe8a406e010 con 0x7fe8a414c3e0 2024-06-11T17:33:31.105 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.105+0000 7fe8aa717640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe8a414c3e0 0x7fe8a414e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:31.105 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.105+0000 7fe8aa717640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe8a414c3e0 0x7fe8a414e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:55072/0 (socket says 172.21.15.130:55072) 2024-06-11T17:33:31.105 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.105+0000 7fe8aa717640 1 -- 172.21.15.130:0/3211930529 learned_addr learned my addr 172.21.15.130:0/3211930529 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:33:31.105 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.105+0000 7fe8a9f16640 1 --1- 172.21.15.130:0/3211930529 >> v1:172.21.15.130:6789/0 conn(0x7fe8a41462b0 0x7fe8a413ff70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:60868/0 (socket says 172.21.15.130:60868) 2024-06-11T17:33:31.106 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.105+0000 7fe8aa717640 1 -- 172.21.15.130:0/3211930529 >> v1:172.21.15.172:6789/0 conn(0x7fe8a406dba0 legacy=0x7fe8a4146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:31.106 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.105+0000 7fe8aa717640 1 -- 172.21.15.130:0/3211930529 >> v1:172.21.15.130:6789/0 conn(0x7fe8a41462b0 legacy=0x7fe8a413ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:31.106 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.105+0000 7fe8aa717640 1 -- 172.21.15.130:0/3211930529 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8a40b3040 con 0x7fe8a414c3e0 2024-06-11T17:33:31.107 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe8aa717640 1 --2- 172.21.15.130:0/3211930529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8a414c3e0 0x7fe8a414e7d0 secure :-1 s=READY pgs=4068 cs=0 l=1 rev1=1 crypto rx=0x7fe89c009e50 tx=0x7fe89c01c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c009d1b6894e803 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:31.107 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe8a8f14640 1 -- 172.21.15.130:0/3211930529 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89c0a55b0 con 0x7fe8a414c3e0 2024-06-11T17:33:31.107 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe8a8f14640 1 -- 172.21.15.130:0/3211930529 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe89c0a5750 con 0x7fe8a414c3e0 2024-06-11T17:33:31.107 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe8a8f14640 1 -- 172.21.15.130:0/3211930529 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89c0a5b20 con 0x7fe8a414c3e0 2024-06-11T17:33:31.108 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe8ac17a640 1 -- 172.21.15.130:0/3211930529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8a414c3e0 msgr2=0x7fe8a414e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:31.108 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe8ac17a640 1 --2- 172.21.15.130:0/3211930529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8a414c3e0 0x7fe8a414e7d0 secure :-1 s=READY pgs=4068 cs=0 l=1 rev1=1 crypto rx=0x7fe89c009e50 tx=0x7fe89c01c8f0 comp rx=0 tx=0).stop 2024-06-11T17:33:31.108 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe8ac17a640 1 -- 172.21.15.130:0/3211930529 shutdown_connections 2024-06-11T17:33:31.108 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe8ac17a640 1 --2- 172.21.15.130:0/3211930529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8a414c3e0 0x7fe8a414e7d0 unknown :-1 s=CLOSED pgs=4068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:31.108 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe8ac17a640 1 -- 172.21.15.130:0/3211930529 >> 172.21.15.130:0/3211930529 conn(0x7fe8a40b69b0 msgr2=0x7fe8a40b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:31.108 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe8ac17a640 1 -- 172.21.15.130:0/3211930529 shutdown_connections 2024-06-11T17:33:31.109 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe8ac17a640 1 -- 172.21.15.130:0/3211930529 wait complete. 2024-06-11T17:33:31.110 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe8ac17a640 1 Processor -- start 2024-06-11T17:33:31.111 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe8ac17a640 1 -- start start 2024-06-11T17:33:31.111 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe8ac17a640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8a406dba0 0x7fe8a40734e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:31.111 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe8ac17a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8a41462b0 0x7fe8a413b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:31.111 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe8ac17a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8a414c3e0 0x7fe8a413be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:31.111 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe8ac17a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a4146fb0 con 0x7fe8a414c3e0 2024-06-11T17:33:31.111 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe8ac17a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a406e8f0 con 0x7fe8a41462b0 2024-06-11T17:33:31.111 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe8ac17a640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe8a4141e60 con 0x7fe8a406dba0 2024-06-11T17:33:31.111 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe8aa717640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8a414c3e0 0x7fe8a413be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:31.112 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe8a9f16640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8a406dba0 0x7fe8a40734e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:31.112 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe8aa717640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8a414c3e0 0x7fe8a413be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:55078/0 (socket says 172.21.15.130:55078) 2024-06-11T17:33:31.112 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe8aa717640 1 -- 172.21.15.130:0/2073968016 learned_addr learned my addr 172.21.15.130:0/2073968016 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:33:31.112 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe8a9715640 1 --2- 172.21.15.130:0/2073968016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8a41462b0 0x7fe8a413b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:31.112 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe8a9f16640 1 -- 172.21.15.130:0/2073968016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8a41462b0 msgr2=0x7fe8a413b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:31.112 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe8a9f16640 1 --2- 172.21.15.130:0/2073968016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8a41462b0 0x7fe8a413b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:31.112 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe8a9f16640 1 -- 172.21.15.130:0/2073968016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8a414c3e0 msgr2=0x7fe8a413be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:31.112 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe8a9f16640 1 --2- 172.21.15.130:0/2073968016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8a414c3e0 0x7fe8a413be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:31.113 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe8a9f16640 1 -- 172.21.15.130:0/2073968016 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8a4142140 con 0x7fe8a406dba0 2024-06-11T17:33:31.113 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe8aa717640 1 --2- 172.21.15.130:0/2073968016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8a414c3e0 0x7fe8a413be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:33:31.113 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe8a9f16640 1 --2- 172.21.15.130:0/2073968016 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8a406dba0 0x7fe8a40734e0 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 crypto rx=0x7fe8a000c410 tx=0x7fe8a000c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:31.113 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe89a7fc640 1 -- 172.21.15.130:0/2073968016 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a00074e0 con 0x7fe8a406dba0 2024-06-11T17:33:31.113 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe89a7fc640 1 -- 172.21.15.130:0/2073968016 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8a0007680 con 0x7fe8a406dba0 2024-06-11T17:33:31.113 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe89a7fc640 1 -- 172.21.15.130:0/2073968016 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a00049f0 con 0x7fe8a406dba0 2024-06-11T17:33:31.113 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.109+0000 7fe8ac17a640 1 -- 172.21.15.130:0/2073968016 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8a4142480 con 0x7fe8a406dba0 2024-06-11T17:33:31.113 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.113+0000 7fe8ac17a640 1 -- 172.21.15.130:0/2073968016 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8a413c360 con 0x7fe8a406dba0 2024-06-11T17:33:31.113 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.113+0000 7fe8ac17a640 1 -- 172.21.15.130:0/2073968016 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe8a4146690 con 0x7fe8a406dba0 2024-06-11T17:33:31.115 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.113+0000 7fe89a7fc640 1 -- 172.21.15.130:0/2073968016 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7fe8a001a020 con 0x7fe8a406dba0 2024-06-11T17:33:31.115 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.113+0000 7fe89a7fc640 1 --2- 172.21.15.130:0/2073968016 >> v2:172.21.15.130:6816/3863300924 conn(0x7fe888070d90 0x7fe888073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:31.115 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.113+0000 7fe89a7fc640 1 -- 172.21.15.130:0/2073968016 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(702..702 src has 449..702) ==== 5253+0+0 (secure 0 0 0) 0x7fe8a0090620 con 0x7fe8a406dba0 2024-06-11T17:33:31.115 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.113+0000 7fe8a9715640 1 --2- 172.21.15.130:0/2073968016 >> v2:172.21.15.130:6816/3863300924 conn(0x7fe888070d90 0x7fe888073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:31.115 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.113+0000 7fe89a7fc640 1 --2- 172.21.15.130:0/2073968016 >> v2:172.21.15.172:6808/1734469189 conn(0x7fe8880786b0 0x7fe88807ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:31.115 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.113+0000 7fe89a7fc640 1 -- 172.21.15.130:0/2073968016 --> v2:172.21.15.172:6808/1734469189 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe88807b1e0 con 0x7fe8880786b0 2024-06-11T17:33:31.116 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.113+0000 7fe89a7fc640 1 -- 172.21.15.130:0/2073968016 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_get_version_reply(handle=1 version=702) ==== 24+0+0 (secure 0 0 0) 0x7fe8a0097050 con 0x7fe8a406dba0 2024-06-11T17:33:31.116 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.113+0000 7fe8a9715640 1 --2- 172.21.15.130:0/2073968016 >> v2:172.21.15.130:6816/3863300924 conn(0x7fe888070d90 0x7fe888073250 secure :-1 s=READY pgs=3451 cs=0 l=1 rev1=1 crypto rx=0x7fe8a4073a20 tx=0x7fe894009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:31.116 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.113+0000 7fe8aa717640 1 --2- 172.21.15.130:0/2073968016 >> v2:172.21.15.172:6808/1734469189 conn(0x7fe8880786b0 0x7fe88807ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:31.116 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.113+0000 7fe8aa717640 1 --2- 172.21.15.130:0/2073968016 >> v2:172.21.15.172:6808/1734469189 conn(0x7fe8880786b0 0x7fe88807ab50 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:31.116 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.117+0000 7fe89a7fc640 1 -- 172.21.15.130:0/2073968016 <== osd.6 v2:172.21.15.172:6808/1734469189 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe88807b1e0 con 0x7fe8880786b0 2024-06-11T17:33:31.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.129+0000 7fe8ac17a640 1 -- 172.21.15.130:0/2073968016 --> v2:172.21.15.172:6808/1734469189 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe8a40b39c0 con 0x7fe8880786b0 2024-06-11T17:33:31.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.129+0000 7fe89a7fc640 1 -- 172.21.15.130:0/2073968016 <== osd.6 v2:172.21.15.172:6808/1734469189 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe8a40b39c0 con 0x7fe8880786b0 2024-06-11T17:33:31.128 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-06-11T17:33:31.128 INFO:teuthology.orchestra.run.smithi130.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-11T17:33:31.128 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-06-11T17:33:31.129 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.129+0000 7fe8ac17a640 1 -- 172.21.15.130:0/2073968016 >> v2:172.21.15.172:6808/1734469189 conn(0x7fe8880786b0 msgr2=0x7fe88807ab50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:31.129 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.129+0000 7fe8ac17a640 1 --2- 172.21.15.130:0/2073968016 >> v2:172.21.15.172:6808/1734469189 conn(0x7fe8880786b0 0x7fe88807ab50 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:31.129 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.129+0000 7fe8ac17a640 1 -- 172.21.15.130:0/2073968016 >> v2:172.21.15.130:6816/3863300924 conn(0x7fe888070d90 msgr2=0x7fe888073250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:31.129 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.129+0000 7fe8ac17a640 1 --2- 172.21.15.130:0/2073968016 >> v2:172.21.15.130:6816/3863300924 conn(0x7fe888070d90 0x7fe888073250 secure :-1 s=READY pgs=3451 cs=0 l=1 rev1=1 crypto rx=0x7fe8a4073a20 tx=0x7fe894009040 comp rx=0 tx=0).stop 2024-06-11T17:33:31.130 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.129+0000 7fe8ac17a640 1 -- 172.21.15.130:0/2073968016 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8a406dba0 msgr2=0x7fe8a40734e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:31.130 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.129+0000 7fe8ac17a640 1 --2- 172.21.15.130:0/2073968016 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8a406dba0 0x7fe8a40734e0 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 crypto rx=0x7fe8a000c410 tx=0x7fe8a000c8d0 comp rx=0 tx=0).stop 2024-06-11T17:33:31.130 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.129+0000 7fe8aa717640 1 -- 172.21.15.130:0/2073968016 reap_dead start 2024-06-11T17:33:31.130 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.129+0000 7fe8ac17a640 1 -- 172.21.15.130:0/2073968016 shutdown_connections 2024-06-11T17:33:31.130 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.129+0000 7fe8ac17a640 1 -- 172.21.15.130:0/2073968016 >> 172.21.15.130:0/2073968016 conn(0x7fe8a40b69b0 msgr2=0x7fe8a40affa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:31.130 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.129+0000 7fe8ac17a640 1 -- 172.21.15.130:0/2073968016 shutdown_connections 2024-06-11T17:33:31.130 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.129+0000 7fe8ac17a640 1 -- 172.21.15.130:0/2073968016 wait complete. 2024-06-11T17:33:31.143 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-06-11T17:33:31.247 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.249+0000 7f5554966640 1 Processor -- start 2024-06-11T17:33:31.248 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.249+0000 7f5554966640 1 -- start start 2024-06-11T17:33:31.249 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.249+0000 7f5554966640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f555006e1d0 0x7f55500b3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:31.249 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.249+0000 7f5554966640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5550143790 0x7f55500b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:31.249 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.249+0000 7f5554966640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5550142ff0 con 0x7f555006ddf0 2024-06-11T17:33:31.249 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.249+0000 7f5554966640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f5550143300 con 0x7f555006e1d0 2024-06-11T17:33:31.249 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.249+0000 7f5554966640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f55500aac20 con 0x7f5550143790 2024-06-11T17:33:31.249 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.249+0000 7f554ed9d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5550143790 0x7f55500b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:31.249 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.249+0000 7f554e59c640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f555006ddf0 0x7f555013c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:60872/0 (socket says 172.21.15.130:60872) 2024-06-11T17:33:31.250 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.249+0000 7f554ed9d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5550143790 0x7f55500b38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:35306/0 (socket says 172.21.15.130:35306) 2024-06-11T17:33:31.250 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.249+0000 7f554e59c640 1 -- 172.21.15.130:0/894587911 learned_addr learned my addr 172.21.15.130:0/894587911 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-06-11T17:33:31.250 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.249+0000 7f554dd9b640 1 --2- 172.21.15.130:0/894587911 >> v2:172.21.15.172:3300/0 conn(0x7f555006e1d0 0x7f55500b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:31.250 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.249+0000 7f554ed9d640 1 -- 172.21.15.130:0/894587911 >> v2:172.21.15.172:3300/0 conn(0x7f555006e1d0 msgr2=0x7f55500b3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:33:31.250 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.249+0000 7f554ed9d640 1 --2- 172.21.15.130:0/894587911 >> v2:172.21.15.172:3300/0 conn(0x7f555006e1d0 0x7f55500b3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:31.250 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.249+0000 7f554ed9d640 1 -- 172.21.15.130:0/894587911 >> v1:172.21.15.130:6789/0 conn(0x7f555006ddf0 legacy=0x7f555013c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:31.250 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.249+0000 7f554ed9d640 1 -- 172.21.15.130:0/894587911 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55500aba90 con 0x7f5550143790 2024-06-11T17:33:31.251 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.249+0000 7f554dd9b640 1 --2- 172.21.15.130:0/894587911 >> v2:172.21.15.172:3300/0 conn(0x7f555006e1d0 0x7f55500b3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-11T17:33:31.252 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.253+0000 7f554ed9d640 1 --2- 172.21.15.130:0/894587911 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5550143790 0x7f55500b38b0 secure :-1 s=READY pgs=2320 cs=0 l=1 rev1=1 crypto rx=0x7f5548009d90 tx=0x7f554801c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92f0530973f83f83 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:31.252 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.253+0000 7f554d59a640 1 -- 172.21.15.130:0/894587911 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55480b2070 con 0x7f5550143790 2024-06-11T17:33:31.252 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.253+0000 7f554d59a640 1 -- 172.21.15.130:0/894587911 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55480a5870 con 0x7f5550143790 2024-06-11T17:33:31.252 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.253+0000 7f554d59a640 1 -- 172.21.15.130:0/894587911 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55480a5c40 con 0x7f5550143790 2024-06-11T17:33:31.252 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.253+0000 7f5554966640 1 -- 172.21.15.130:0/894587911 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5550143790 msgr2=0x7f55500b38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:31.252 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.253+0000 7f5554966640 1 --2- 172.21.15.130:0/894587911 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5550143790 0x7f55500b38b0 secure :-1 s=READY pgs=2320 cs=0 l=1 rev1=1 crypto rx=0x7f5548009d90 tx=0x7f554801c8c0 comp rx=0 tx=0).stop 2024-06-11T17:33:31.253 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.253+0000 7f5554966640 1 -- 172.21.15.130:0/894587911 shutdown_connections 2024-06-11T17:33:31.253 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.253+0000 7f5554966640 1 --2- 172.21.15.130:0/894587911 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5550143790 0x7f55500b38b0 unknown :-1 s=CLOSED pgs=2320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:31.253 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.253+0000 7f5554966640 1 --2- 172.21.15.130:0/894587911 >> v2:172.21.15.172:3300/0 conn(0x7f555006e1d0 0x7f55500b3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:31.253 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.253+0000 7f5554966640 1 -- 172.21.15.130:0/894587911 >> 172.21.15.130:0/894587911 conn(0x7f55500b8d70 msgr2=0x7f55500b9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:31.253 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.253+0000 7f5554966640 1 -- 172.21.15.130:0/894587911 shutdown_connections 2024-06-11T17:33:31.253 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.253+0000 7f5554966640 1 -- 172.21.15.130:0/894587911 wait complete. 2024-06-11T17:33:31.256 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.253+0000 7f5554966640 1 Processor -- start 2024-06-11T17:33:31.256 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.253+0000 7f5554966640 1 -- start start 2024-06-11T17:33:31.256 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.253+0000 7f5554966640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f555006ddf0 0x7f5550149d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:31.256 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.253+0000 7f5554966640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5550143790 0x7f555014c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:31.256 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.253+0000 7f5554966640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f555014a530 0x7f555014cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:31.256 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.253+0000 7f5554966640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f555014fe50 con 0x7f555014a530 2024-06-11T17:33:31.257 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.253+0000 7f5554966640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f555014ffd0 con 0x7f555006ddf0 2024-06-11T17:33:31.257 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.253+0000 7f5554966640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f5550150150 con 0x7f5550143790 2024-06-11T17:33:31.257 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.253+0000 7f554dd9b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5550143790 0x7f555014c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:31.257 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.253+0000 7f554ed9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f555014a530 0x7f555014cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:31.257 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.253+0000 7f554dd9b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5550143790 0x7f555014c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:35320/0 (socket says 172.21.15.130:35320) 2024-06-11T17:33:31.257 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.253+0000 7f554dd9b640 1 -- 172.21.15.130:0/2077328342 learned_addr learned my addr 172.21.15.130:0/2077328342 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:33:31.257 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.253+0000 7f554e59c640 1 --2- 172.21.15.130:0/2077328342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f555006ddf0 0x7f5550149d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:31.257 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.253+0000 7f554ed9d640 1 -- 172.21.15.130:0/2077328342 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5550143790 msgr2=0x7f555014c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:31.257 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.253+0000 7f554ed9d640 1 --2- 172.21.15.130:0/2077328342 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5550143790 0x7f555014c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:31.258 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.253+0000 7f554ed9d640 1 -- 172.21.15.130:0/2077328342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f555006ddf0 msgr2=0x7f5550149d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:31.258 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.253+0000 7f554ed9d640 1 --2- 172.21.15.130:0/2077328342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f555006ddf0 0x7f5550149d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:31.258 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.253+0000 7f554ed9d640 1 -- 172.21.15.130:0/2077328342 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f555014be80 con 0x7f555014a530 2024-06-11T17:33:31.258 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.253+0000 7f554e59c640 1 --2- 172.21.15.130:0/2077328342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f555006ddf0 0x7f5550149d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-11T17:33:31.258 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.253+0000 7f554ed9d640 1 --2- 172.21.15.130:0/2077328342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f555014a530 0x7f555014cac0 secure :-1 s=READY pgs=4070 cs=0 l=1 rev1=1 crypto rx=0x7f55501432b0 tx=0x7f5548019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:31.258 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.257+0000 7f553effd640 1 -- 172.21.15.130:0/2077328342 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55480b2050 con 0x7f555014a530 2024-06-11T17:33:31.258 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.257+0000 7f553effd640 1 -- 172.21.15.130:0/2077328342 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55480b3040 con 0x7f555014a530 2024-06-11T17:33:31.259 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.257+0000 7f5554966640 1 -- 172.21.15.130:0/2077328342 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f555014c160 con 0x7f555014a530 2024-06-11T17:33:31.259 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.257+0000 7f553effd640 1 -- 172.21.15.130:0/2077328342 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55480ad870 con 0x7f555014a530 2024-06-11T17:33:31.259 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.257+0000 7f5554966640 1 -- 172.21.15.130:0/2077328342 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f555014a2a0 con 0x7f555014a530 2024-06-11T17:33:31.259 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.257+0000 7f5554966640 1 -- 172.21.15.130:0/2077328342 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f555013c710 con 0x7f555014a530 2024-06-11T17:33:31.260 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.257+0000 7f553effd640 1 -- 172.21.15.130:0/2077328342 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f55480c0020 con 0x7f555014a530 2024-06-11T17:33:31.260 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.257+0000 7f553effd640 1 --2- 172.21.15.130:0/2077328342 >> v2:172.21.15.130:6816/3863300924 conn(0x7f5530070d60 0x7f5530073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:31.260 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.257+0000 7f554e59c640 1 --2- 172.21.15.130:0/2077328342 >> v2:172.21.15.130:6816/3863300924 conn(0x7f5530070d60 0x7f5530073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:31.260 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.257+0000 7f553effd640 1 -- 172.21.15.130:0/2077328342 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(702..702 src has 449..702) ==== 5253+0+0 (secure 0 0 0) 0x7f554812c040 con 0x7f555014a530 2024-06-11T17:33:31.261 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.257+0000 7f554e59c640 1 --2- 172.21.15.130:0/2077328342 >> v2:172.21.15.130:6816/3863300924 conn(0x7f5530070d60 0x7f5530073220 secure :-1 s=READY pgs=3452 cs=0 l=1 rev1=1 crypto rx=0x7f5540000f70 tx=0x7f5540009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:31.261 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.261+0000 7f553effd640 1 -- 172.21.15.130:0/2077328342 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7f55480c7020 con 0x7f555014a530 2024-06-11T17:33:31.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.417+0000 7f5554966640 1 -- 172.21.15.130:0/2077328342 --> v2:172.21.15.130:6816/3863300924 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f55500b85b0 con 0x7f5530070d60 2024-06-11T17:33:31.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.417+0000 7f553effd640 1 -- 172.21.15.130:0/2077328342 <== mgr.4107 v2:172.21.15.130:6816/3863300924 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f55500b85b0 con 0x7f5530070d60 2024-06-11T17:33:31.415 INFO:teuthology.orchestra.run.smithi130.stderr:instructed osd(s) 6 to deep-scrub 2024-06-11T17:33:31.417 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.417+0000 7f5554966640 1 -- 172.21.15.130:0/2077328342 >> v2:172.21.15.130:6816/3863300924 conn(0x7f5530070d60 msgr2=0x7f5530073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:31.417 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.417+0000 7f5554966640 1 --2- 172.21.15.130:0/2077328342 >> v2:172.21.15.130:6816/3863300924 conn(0x7f5530070d60 0x7f5530073220 secure :-1 s=READY pgs=3452 cs=0 l=1 rev1=1 crypto rx=0x7f5540000f70 tx=0x7f5540009040 comp rx=0 tx=0).stop 2024-06-11T17:33:31.417 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.417+0000 7f5554966640 1 -- 172.21.15.130:0/2077328342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f555014a530 msgr2=0x7f555014cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:31.417 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.417+0000 7f5554966640 1 --2- 172.21.15.130:0/2077328342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f555014a530 0x7f555014cac0 secure :-1 s=READY pgs=4070 cs=0 l=1 rev1=1 crypto rx=0x7f55501432b0 tx=0x7f5548019660 comp rx=0 tx=0).stop 2024-06-11T17:33:31.418 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.417+0000 7f5554966640 1 -- 172.21.15.130:0/2077328342 shutdown_connections 2024-06-11T17:33:31.418 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.417+0000 7f5554966640 1 --2- 172.21.15.130:0/2077328342 >> v2:172.21.15.130:6816/3863300924 conn(0x7f5530070d60 0x7f5530073220 unknown :-1 s=CLOSED pgs=3452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:31.418 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.417+0000 7f5554966640 1 --2- 172.21.15.130:0/2077328342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f555014a530 0x7f555014cac0 unknown :-1 s=CLOSED pgs=4070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:31.418 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.417+0000 7f5554966640 1 --2- 172.21.15.130:0/2077328342 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5550143790 0x7f555014c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:31.418 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.417+0000 7f5554966640 1 --2- 172.21.15.130:0/2077328342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f555006ddf0 0x7f5550149d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:31.418 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.417+0000 7f5554966640 1 -- 172.21.15.130:0/2077328342 >> 172.21.15.130:0/2077328342 conn(0x7f55500b8d70 msgr2=0x7f5550145ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:31.418 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.417+0000 7f5554966640 1 -- 172.21.15.130:0/2077328342 shutdown_connections 2024-06-11T17:33:31.419 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.417+0000 7f5554966640 1 -- 172.21.15.130:0/2077328342 wait complete. 2024-06-11T17:33:31.433 INFO:tasks.ceph:Scrubbing osd.7 2024-06-11T17:33:31.433 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-06-11T17:33:31.556 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.557+0000 7f4346018640 1 Processor -- start 2024-06-11T17:33:31.557 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.557+0000 7f4346018640 1 -- start start 2024-06-11T17:33:31.558 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.557+0000 7f4346018640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f434013ffd0 0x7f434013c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:31.558 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.557+0000 7f4346018640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43400ad930 con 0x7f434013cc70 2024-06-11T17:33:31.558 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.557+0000 7f4346018640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43400adc10 con 0x7f43400af380 2024-06-11T17:33:31.558 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.557+0000 7f4346018640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f43400af760 con 0x7f434013ffd0 2024-06-11T17:33:31.558 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.557+0000 7f433effd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f434013ffd0 0x7f434013c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:31.558 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.557+0000 7f433effd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f434013ffd0 0x7f434013c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:35336/0 (socket says 172.21.15.130:35336) 2024-06-11T17:33:31.558 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.557+0000 7f433effd640 1 -- 172.21.15.130:0/2874248246 learned_addr learned my addr 172.21.15.130:0/2874248246 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:33:31.559 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.557+0000 7f433effd640 1 -- 172.21.15.130:0/2874248246 >> v1:172.21.15.172:6789/0 conn(0x7f43400af380 legacy=0x7f434013f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:31.559 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.557+0000 7f433e7fc640 1 -- 172.21.15.130:0/2874248246 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 299923127 0 0) 0x7f43400ad930 con 0x7f434013cc70 2024-06-11T17:33:31.559 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.557+0000 7f433effd640 1 -- 172.21.15.130:0/2874248246 >> v1:172.21.15.130:6789/0 conn(0x7f434013cc70 legacy=0x7f434014a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:31.559 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.557+0000 7f433effd640 1 -- 172.21.15.130:0/2874248246 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f434013d400 con 0x7f434013ffd0 2024-06-11T17:33:31.560 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.561+0000 7f433effd640 1 --2- 172.21.15.130:0/2874248246 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f434013ffd0 0x7f434013c730 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 crypto rx=0x7f43340098a0 tx=0x7f433401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fdd5a5c9b3a28a2 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:31.560 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.561+0000 7f433e7fc640 1 -- 172.21.15.130:0/2874248246 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43340a7070 con 0x7f434013ffd0 2024-06-11T17:33:31.560 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.561+0000 7f433e7fc640 1 -- 172.21.15.130:0/2874248246 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43340b0070 con 0x7f434013ffd0 2024-06-11T17:33:31.560 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.561+0000 7f433e7fc640 1 -- 172.21.15.130:0/2874248246 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43340ab890 con 0x7f434013ffd0 2024-06-11T17:33:31.561 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.561+0000 7f4346018640 1 -- 172.21.15.130:0/2874248246 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f434013ffd0 msgr2=0x7f434013c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:31.561 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.561+0000 7f4346018640 1 --2- 172.21.15.130:0/2874248246 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f434013ffd0 0x7f434013c730 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 crypto rx=0x7f43340098a0 tx=0x7f433401c560 comp rx=0 tx=0).stop 2024-06-11T17:33:31.561 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.561+0000 7f4346018640 1 -- 172.21.15.130:0/2874248246 shutdown_connections 2024-06-11T17:33:31.561 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.561+0000 7f4346018640 1 --2- 172.21.15.130:0/2874248246 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f434013ffd0 0x7f434013c730 unknown :-1 s=CLOSED pgs=2321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:31.562 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.561+0000 7f4346018640 1 -- 172.21.15.130:0/2874248246 >> 172.21.15.130:0/2874248246 conn(0x7f434006cb60 msgr2=0x7f43400b4720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:31.562 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.561+0000 7f4346018640 1 -- 172.21.15.130:0/2874248246 shutdown_connections 2024-06-11T17:33:31.562 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.561+0000 7f4346018640 1 -- 172.21.15.130:0/2874248246 wait complete. 2024-06-11T17:33:31.564 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.561+0000 7f4346018640 1 Processor -- start 2024-06-11T17:33:31.564 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.561+0000 7f4346018640 1 -- start start 2024-06-11T17:33:31.564 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f4346018640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43400af380 0x7f43400afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:31.564 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f4346018640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f434013cc70 0x7f43401395b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:31.564 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f4346018640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f434013ffd0 0x7f434013a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:31.565 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f4346018640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f434014e6a0 con 0x7f43400af380 2024-06-11T17:33:31.565 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f4346018640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f434014e520 con 0x7f434013ffd0 2024-06-11T17:33:31.565 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f4346018640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f434014e820 con 0x7f434013cc70 2024-06-11T17:33:31.565 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f433f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43400af380 0x7f43400afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:31.565 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f433effd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f434013cc70 0x7f43401395b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:31.565 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f433f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43400af380 0x7f43400afc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:55086/0 (socket says 172.21.15.130:55086) 2024-06-11T17:33:31.565 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f433effd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f434013cc70 0x7f43401395b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:35350/0 (socket says 172.21.15.130:35350) 2024-06-11T17:33:31.565 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f433f7fe640 1 -- 172.21.15.130:0/1975846575 learned_addr learned my addr 172.21.15.130:0/1975846575 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:33:31.565 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f433ffff640 1 --2- 172.21.15.130:0/1975846575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f434013ffd0 0x7f434013a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:31.566 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f433effd640 1 -- 172.21.15.130:0/1975846575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f434013ffd0 msgr2=0x7f434013a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:31.566 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f433effd640 1 --2- 172.21.15.130:0/1975846575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f434013ffd0 0x7f434013a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:31.566 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f433effd640 1 -- 172.21.15.130:0/1975846575 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43400af380 msgr2=0x7f43400afc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:31.566 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f433effd640 1 --2- 172.21.15.130:0/1975846575 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43400af380 0x7f43400afc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:31.566 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f433effd640 1 -- 172.21.15.130:0/1975846575 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f434013b930 con 0x7f434013cc70 2024-06-11T17:33:31.566 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f433f7fe640 1 --2- 172.21.15.130:0/1975846575 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43400af380 0x7f43400afc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:33:31.566 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f433ffff640 1 --2- 172.21.15.130:0/1975846575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f434013ffd0 0x7f434013a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-11T17:33:31.566 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f433effd640 1 --2- 172.21.15.130:0/1975846575 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f434013cc70 0x7f43401395b0 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 crypto rx=0x7f43340ac000 tx=0x7f433401ada0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:31.567 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f4327fff640 1 -- 172.21.15.130:0/1975846575 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43340be5f0 con 0x7f434013cc70 2024-06-11T17:33:31.567 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f4327fff640 1 -- 172.21.15.130:0/1975846575 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43340be7b0 con 0x7f434013cc70 2024-06-11T17:33:31.567 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f4346018640 1 -- 172.21.15.130:0/1975846575 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f434013bc10 con 0x7f434013cc70 2024-06-11T17:33:31.567 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f4327fff640 1 -- 172.21.15.130:0/1975846575 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43340beba0 con 0x7f434013cc70 2024-06-11T17:33:31.567 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f4346018640 1 -- 172.21.15.130:0/1975846575 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f43401dc9d0 con 0x7f434013cc70 2024-06-11T17:33:31.567 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f4346018640 1 -- 172.21.15.130:0/1975846575 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f434013c730 con 0x7f434013cc70 2024-06-11T17:33:31.568 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f4327fff640 1 -- 172.21.15.130:0/1975846575 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f43340b4600 con 0x7f434013cc70 2024-06-11T17:33:31.568 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f4327fff640 1 --2- 172.21.15.130:0/1975846575 >> v2:172.21.15.130:6816/3863300924 conn(0x7f432c070d60 0x7f432c073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:31.569 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f4327fff640 1 -- 172.21.15.130:0/1975846575 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(702..702 src has 449..702) ==== 5253+0+0 (secure 0 0 0) 0x7f433412be40 con 0x7f434013cc70 2024-06-11T17:33:31.569 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f433f7fe640 1 --2- 172.21.15.130:0/1975846575 >> v2:172.21.15.130:6816/3863300924 conn(0x7f432c070d60 0x7f432c073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:31.569 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f4327fff640 1 --2- 172.21.15.130:0/1975846575 >> v2:172.21.15.172:6801/3950047248 conn(0x7f432c078680 0x7f432c07ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:31.569 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f4327fff640 1 -- 172.21.15.130:0/1975846575 --> v2:172.21.15.172:6801/3950047248 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f43340c9ec0 con 0x7f432c078680 2024-06-11T17:33:31.569 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f4327fff640 1 -- 172.21.15.130:0/1975846575 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_get_version_reply(handle=1 version=702) ==== 24+0+0 (secure 0 0 0) 0x7f433412c2d0 con 0x7f434013cc70 2024-06-11T17:33:31.569 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f433f7fe640 1 --2- 172.21.15.130:0/1975846575 >> v2:172.21.15.130:6816/3863300924 conn(0x7f432c070d60 0x7f432c073220 secure :-1 s=READY pgs=3453 cs=0 l=1 rev1=1 crypto rx=0x7f4330000f70 tx=0x7f4330009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:31.569 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.565+0000 7f433ffff640 1 --2- 172.21.15.130:0/1975846575 >> v2:172.21.15.172:6801/3950047248 conn(0x7f432c078680 0x7f432c07ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:31.569 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.569+0000 7f433ffff640 1 --2- 172.21.15.130:0/1975846575 >> v2:172.21.15.172:6801/3950047248 conn(0x7f432c078680 0x7f432c07ab20 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:31.569 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.569+0000 7f4327fff640 1 -- 172.21.15.130:0/1975846575 <== osd.7 v2:172.21.15.172:6801/3950047248 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f43340c9ec0 con 0x7f432c078680 2024-06-11T17:33:31.581 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.581+0000 7f4346018640 1 -- 172.21.15.130:0/1975846575 --> v2:172.21.15.172:6801/3950047248 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f434013a950 con 0x7f432c078680 2024-06-11T17:33:31.582 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.585+0000 7f4327fff640 1 -- 172.21.15.130:0/1975846575 <== osd.7 v2:172.21.15.172:6801/3950047248 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f434013a950 con 0x7f432c078680 2024-06-11T17:33:31.582 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-06-11T17:33:31.583 INFO:teuthology.orchestra.run.smithi130.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-11T17:33:31.583 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-06-11T17:33:31.584 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.585+0000 7f4346018640 1 -- 172.21.15.130:0/1975846575 >> v2:172.21.15.172:6801/3950047248 conn(0x7f432c078680 msgr2=0x7f432c07ab20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:31.584 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.585+0000 7f4346018640 1 --2- 172.21.15.130:0/1975846575 >> v2:172.21.15.172:6801/3950047248 conn(0x7f432c078680 0x7f432c07ab20 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:31.584 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.585+0000 7f4346018640 1 -- 172.21.15.130:0/1975846575 >> v2:172.21.15.130:6816/3863300924 conn(0x7f432c070d60 msgr2=0x7f432c073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:31.584 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.585+0000 7f4346018640 1 --2- 172.21.15.130:0/1975846575 >> v2:172.21.15.130:6816/3863300924 conn(0x7f432c070d60 0x7f432c073220 secure :-1 s=READY pgs=3453 cs=0 l=1 rev1=1 crypto rx=0x7f4330000f70 tx=0x7f4330009040 comp rx=0 tx=0).stop 2024-06-11T17:33:31.584 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.585+0000 7f4346018640 1 -- 172.21.15.130:0/1975846575 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f434013cc70 msgr2=0x7f43401395b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:31.584 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.585+0000 7f4346018640 1 --2- 172.21.15.130:0/1975846575 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f434013cc70 0x7f43401395b0 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 crypto rx=0x7f43340ac000 tx=0x7f433401ada0 comp rx=0 tx=0).stop 2024-06-11T17:33:31.584 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.585+0000 7f433ffff640 1 -- 172.21.15.130:0/1975846575 reap_dead start 2024-06-11T17:33:31.585 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.585+0000 7f4346018640 1 -- 172.21.15.130:0/1975846575 shutdown_connections 2024-06-11T17:33:31.585 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.585+0000 7f4346018640 1 -- 172.21.15.130:0/1975846575 >> 172.21.15.130:0/1975846575 conn(0x7f434006cb60 msgr2=0x7f43400b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:31.585 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.585+0000 7f4346018640 1 -- 172.21.15.130:0/1975846575 shutdown_connections 2024-06-11T17:33:31.585 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.585+0000 7f4346018640 1 -- 172.21.15.130:0/1975846575 wait complete. 2024-06-11T17:33:31.599 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-06-11T17:33:31.711 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f9434f74640 1 Processor -- start 2024-06-11T17:33:31.711 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f9434f74640 1 -- start start 2024-06-11T17:33:31.713 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f9434f74640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f94300aca80 0x7f943013dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:31.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f9434f74640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94300aede0 con 0x7f943013e280 2024-06-11T17:33:31.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f9434f74640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94300ad790 con 0x7f94301412f0 2024-06-11T17:33:31.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f9434f74640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f94300adbe0 con 0x7f94300aca80 2024-06-11T17:33:31.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f942dd9b640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f943013e280 0x7f9430140be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:60890/0 (socket says 172.21.15.130:60890) 2024-06-11T17:33:31.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f942dd9b640 1 -- 172.21.15.130:0/3423331169 learned_addr learned my addr 172.21.15.130:0/3423331169 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-06-11T17:33:31.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f942e59c640 1 --2- 172.21.15.130:0/3423331169 >> v2:172.21.15.172:3300/0 conn(0x7f94300aca80 0x7f943013dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:31.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f942d59a640 1 -- 172.21.15.130:0/3423331169 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 90600714 0 0) 0x7f94300aede0 con 0x7f943013e280 2024-06-11T17:33:31.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f942d59a640 1 -- 172.21.15.130:0/3423331169 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9418003530 con 0x7f943013e280 2024-06-11T17:33:31.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f942d59a640 1 -- 172.21.15.130:0/3423331169 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 992020352 0 0) 0x7f9418003530 con 0x7f943013e280 2024-06-11T17:33:31.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f942d59a640 1 -- 172.21.15.130:0/3423331169 >> v2:172.21.15.172:3300/0 conn(0x7f94300aca80 msgr2=0x7f943013dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:33:31.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f942d59a640 1 --2- 172.21.15.130:0/3423331169 >> v2:172.21.15.172:3300/0 conn(0x7f94300aca80 0x7f943013dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:31.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f942d59a640 1 -- 172.21.15.130:0/3423331169 >> v1:172.21.15.172:6789/0 conn(0x7f94301412f0 legacy=0x7f943014b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:31.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f942d59a640 1 -- 172.21.15.130:0/3423331169 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94300ad240 con 0x7f943013e280 2024-06-11T17:33:31.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f942d59a640 1 -- 172.21.15.130:0/3423331169 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3158545239 0 0) 0x7f9420001700 con 0x7f943013e280 2024-06-11T17:33:31.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f942d59a640 1 -- 172.21.15.130:0/3423331169 >> v1:172.21.15.130:6789/0 conn(0x7f943013e280 legacy=0x7f9430140be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:31.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f942d59a640 1 --2- 172.21.15.130:0/3423331169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9418003a60 0x7f9418003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:31.716 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f942d59a640 1 --2- 172.21.15.130:0/3423331169 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9418004810 0x7f9418004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:31.716 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f942d59a640 1 --2- 172.21.15.130:0/3423331169 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94180052f0 0x7f941800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:31.716 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f942d59a640 1 -- 172.21.15.130:0/3423331169 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f94300adbe0 con 0x7f9418004810 2024-06-11T17:33:31.716 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f942d59a640 1 -- 172.21.15.130:0/3423331169 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f941800c1c0 con 0x7f9418003a60 2024-06-11T17:33:31.716 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f942d59a640 1 -- 172.21.15.130:0/3423331169 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f941800c3c0 con 0x7f94180052f0 2024-06-11T17:33:31.716 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f942dd9b640 1 --2- 172.21.15.130:0/3423331169 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9418004810 0x7f9418004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:31.716 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f942ed9d640 1 --2- 172.21.15.130:0/3423331169 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94180052f0 0x7f941800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:31.716 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f942e59c640 1 --2- 172.21.15.130:0/3423331169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9418003a60 0x7f9418003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:31.716 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f942dd9b640 1 -- 172.21.15.130:0/3423331169 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94180052f0 msgr2=0x7f941800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:33:31.717 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f942dd9b640 1 --2- 172.21.15.130:0/3423331169 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94180052f0 0x7f941800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:31.717 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f942dd9b640 1 -- 172.21.15.130:0/3423331169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9418003a60 msgr2=0x7f9418003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:33:31.717 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f942dd9b640 1 --2- 172.21.15.130:0/3423331169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9418003a60 0x7f9418003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:31.717 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f942dd9b640 1 -- 172.21.15.130:0/3423331169 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9418003530 con 0x7f9418004810 2024-06-11T17:33:31.717 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f942ed9d640 1 --2- 172.21.15.130:0/3423331169 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94180052f0 0x7f941800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:33:31.717 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f942e59c640 1 --2- 172.21.15.130:0/3423331169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9418003a60 0x7f9418003e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-11T17:33:31.717 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.713+0000 7f942ed9d640 1 -- 172.21.15.130:0/3423331169 reap_dead start 2024-06-11T17:33:31.720 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.717+0000 7f942dd9b640 1 --2- 172.21.15.130:0/3423331169 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9418004810 0x7f9418004c90 secure :-1 s=READY pgs=4073 cs=0 l=1 rev1=1 crypto rx=0x7f942000c210 tx=0x7f942001cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=207b96c3a1e043a1 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:31.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.717+0000 7f942d59a640 1 -- 172.21.15.130:0/3423331169 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9420007d80 con 0x7f9418004810 2024-06-11T17:33:31.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.717+0000 7f942d59a640 1 -- 172.21.15.130:0/3423331169 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94200a9020 con 0x7f9418004810 2024-06-11T17:33:31.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.717+0000 7f942d59a640 1 -- 172.21.15.130:0/3423331169 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9420005ae0 con 0x7f9418004810 2024-06-11T17:33:31.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.717+0000 7f9434f74640 1 -- 172.21.15.130:0/3423331169 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9418004810 msgr2=0x7f9418004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:31.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.717+0000 7f9434f74640 1 --2- 172.21.15.130:0/3423331169 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9418004810 0x7f9418004c90 secure :-1 s=READY pgs=4073 cs=0 l=1 rev1=1 crypto rx=0x7f942000c210 tx=0x7f942001cb60 comp rx=0 tx=0).stop 2024-06-11T17:33:31.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.717+0000 7f9434f74640 1 -- 172.21.15.130:0/3423331169 shutdown_connections 2024-06-11T17:33:31.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.717+0000 7f9434f74640 1 --2- 172.21.15.130:0/3423331169 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9418004810 0x7f9418004c90 unknown :-1 s=CLOSED pgs=4073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:31.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.717+0000 7f9434f74640 1 -- 172.21.15.130:0/3423331169 >> 172.21.15.130:0/3423331169 conn(0x7f94300b46b0 msgr2=0x7f94300b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:31.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.717+0000 7f9434f74640 1 -- 172.21.15.130:0/3423331169 shutdown_connections 2024-06-11T17:33:31.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.717+0000 7f9434f74640 1 -- 172.21.15.130:0/3423331169 wait complete. 2024-06-11T17:33:31.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.717+0000 7f9434f74640 1 Processor -- start 2024-06-11T17:33:31.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.717+0000 7f9434f74640 1 -- start start 2024-06-11T17:33:31.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.717+0000 7f9434f74640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9418004810 0x7f94301d1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:31.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.717+0000 7f9434f74640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f943013a600 0x7f94301cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:31.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.717+0000 7f9434f74640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94301cc440 0x7f94301dec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:31.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.717+0000 7f9434f74640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9430073bb0 con 0x7f9418004810 2024-06-11T17:33:31.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.717+0000 7f9434f74640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9430141910 con 0x7f943013a600 2024-06-11T17:33:31.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.717+0000 7f9434f74640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9430073d30 con 0x7f94301cc440 2024-06-11T17:33:31.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.717+0000 7f942e59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9418004810 0x7f94301d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:31.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.717+0000 7f942e59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9418004810 0x7f94301d1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:55100/0 (socket says 172.21.15.130:55100) 2024-06-11T17:33:31.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.717+0000 7f942e59c640 1 -- 172.21.15.130:0/1333342962 learned_addr learned my addr 172.21.15.130:0/1333342962 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:33:31.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.717+0000 7f942ed9d640 1 --2- 172.21.15.130:0/1333342962 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94301cc440 0x7f94301dec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:31.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.717+0000 7f942dd9b640 1 --2- 172.21.15.130:0/1333342962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f943013a600 0x7f94301cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:31.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.717+0000 7f942ed9d640 1 -- 172.21.15.130:0/1333342962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f943013a600 msgr2=0x7f94301cdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:31.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.717+0000 7f942ed9d640 1 --2- 172.21.15.130:0/1333342962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f943013a600 0x7f94301cdfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:31.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.717+0000 7f942ed9d640 1 -- 172.21.15.130:0/1333342962 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9418004810 msgr2=0x7f94301d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:31.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.717+0000 7f942ed9d640 1 --2- 172.21.15.130:0/1333342962 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9418004810 0x7f94301d1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:31.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.717+0000 7f942ed9d640 1 -- 172.21.15.130:0/1333342962 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94301ce4e0 con 0x7f94301cc440 2024-06-11T17:33:31.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.717+0000 7f942e59c640 1 --2- 172.21.15.130:0/1333342962 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9418004810 0x7f94301d1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:33:31.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.717+0000 7f942ed9d640 1 --2- 172.21.15.130:0/1333342962 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94301cc440 0x7f94301dec00 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 crypto rx=0x7f94300b09b0 tx=0x7f94280021f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:31.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.717+0000 7f941effd640 1 -- 172.21.15.130:0/1333342962 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9428001ae0 con 0x7f94301cc440 2024-06-11T17:33:31.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.721+0000 7f941effd640 1 -- 172.21.15.130:0/1333342962 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9428003b90 con 0x7f94301cc440 2024-06-11T17:33:31.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.721+0000 7f9434f74640 1 -- 172.21.15.130:0/1333342962 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94301cd2e0 con 0x7f94301cc440 2024-06-11T17:33:31.725 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.721+0000 7f941effd640 1 -- 172.21.15.130:0/1333342962 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9428003d60 con 0x7f94301cc440 2024-06-11T17:33:31.725 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.721+0000 7f9434f74640 1 -- 172.21.15.130:0/1333342962 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f94301cd8a0 con 0x7f94301cc440 2024-06-11T17:33:31.725 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.721+0000 7f9434f74640 1 -- 172.21.15.130:0/1333342962 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94301446b0 con 0x7f94301cc440 2024-06-11T17:33:31.725 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.721+0000 7f941effd640 1 -- 172.21.15.130:0/1333342962 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f942801b020 con 0x7f94301cc440 2024-06-11T17:33:31.725 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.721+0000 7f941effd640 1 --2- 172.21.15.130:0/1333342962 >> v2:172.21.15.130:6816/3863300924 conn(0x7f9410070d60 0x7f9410073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:31.725 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.721+0000 7f941effd640 1 -- 172.21.15.130:0/1333342962 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(702..702 src has 449..702) ==== 5253+0+0 (secure 0 0 0) 0x7f9428090770 con 0x7f94301cc440 2024-06-11T17:33:31.725 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.721+0000 7f942e59c640 1 --2- 172.21.15.130:0/1333342962 >> v2:172.21.15.130:6816/3863300924 conn(0x7f9410070d60 0x7f9410073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:31.725 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.721+0000 7f942e59c640 1 --2- 172.21.15.130:0/1333342962 >> v2:172.21.15.130:6816/3863300924 conn(0x7f9410070d60 0x7f9410073220 secure :-1 s=READY pgs=3454 cs=0 l=1 rev1=1 crypto rx=0x7f9424006aa0 tx=0x7f9424008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:31.726 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.725+0000 7f941effd640 1 -- 172.21.15.130:0/1333342962 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7f942805c550 con 0x7f94301cc440 2024-06-11T17:33:31.890 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.893+0000 7f9434f74640 1 -- 172.21.15.130:0/1333342962 --> v2:172.21.15.130:6816/3863300924 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f94301d1f30 con 0x7f9410070d60 2024-06-11T17:33:31.891 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.893+0000 7f941effd640 1 -- 172.21.15.130:0/1333342962 <== mgr.4107 v2:172.21.15.130:6816/3863300924 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f94301d1f30 con 0x7f9410070d60 2024-06-11T17:33:31.891 INFO:teuthology.orchestra.run.smithi130.stderr:instructed osd(s) 7 to deep-scrub 2024-06-11T17:33:31.893 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.893+0000 7f9434f74640 1 -- 172.21.15.130:0/1333342962 >> v2:172.21.15.130:6816/3863300924 conn(0x7f9410070d60 msgr2=0x7f9410073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:31.893 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.893+0000 7f9434f74640 1 --2- 172.21.15.130:0/1333342962 >> v2:172.21.15.130:6816/3863300924 conn(0x7f9410070d60 0x7f9410073220 secure :-1 s=READY pgs=3454 cs=0 l=1 rev1=1 crypto rx=0x7f9424006aa0 tx=0x7f9424008040 comp rx=0 tx=0).stop 2024-06-11T17:33:31.893 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.893+0000 7f9434f74640 1 -- 172.21.15.130:0/1333342962 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94301cc440 msgr2=0x7f94301dec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:31.894 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.893+0000 7f9434f74640 1 --2- 172.21.15.130:0/1333342962 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94301cc440 0x7f94301dec00 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 crypto rx=0x7f94300b09b0 tx=0x7f94280021f0 comp rx=0 tx=0).stop 2024-06-11T17:33:31.894 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.893+0000 7f9434f74640 1 -- 172.21.15.130:0/1333342962 shutdown_connections 2024-06-11T17:33:31.894 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.893+0000 7f9434f74640 1 --2- 172.21.15.130:0/1333342962 >> v2:172.21.15.130:6816/3863300924 conn(0x7f9410070d60 0x7f9410073220 unknown :-1 s=CLOSED pgs=3454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:31.894 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.893+0000 7f9434f74640 1 --2- 172.21.15.130:0/1333342962 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94301cc440 0x7f94301dec00 unknown :-1 s=CLOSED pgs=2323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:31.894 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.893+0000 7f9434f74640 1 --2- 172.21.15.130:0/1333342962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f943013a600 0x7f94301cdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:31.894 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.893+0000 7f9434f74640 1 --2- 172.21.15.130:0/1333342962 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9418004810 0x7f94301d1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:31.894 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.893+0000 7f9434f74640 1 -- 172.21.15.130:0/1333342962 >> 172.21.15.130:0/1333342962 conn(0x7f94300b46b0 msgr2=0x7f94300aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:31.894 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.893+0000 7f9434f74640 1 -- 172.21.15.130:0/1333342962 shutdown_connections 2024-06-11T17:33:31.895 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:31.893+0000 7f9434f74640 1 -- 172.21.15.130:0/1333342962 wait complete. 2024-06-11T17:33:31.911 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-11T17:33:32.027 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.029+0000 7f72ff4df640 1 Processor -- start 2024-06-11T17:33:32.027 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.029+0000 7f72ff4df640 1 -- start start 2024-06-11T17:33:32.029 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.029+0000 7f72ff4df640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f72f80b53c0 0x7f72f80b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:32.029 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.029+0000 7f72ff4df640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72f8142cb0 con 0x7f72f80b1ef0 2024-06-11T17:33:32.029 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.029+0000 7f72ff4df640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72f80b2e30 con 0x7f72f80b4cd0 2024-06-11T17:33:32.029 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.029+0000 7f72ff4df640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f72f80b3000 con 0x7f72f80b53c0 2024-06-11T17:33:32.029 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.029+0000 7f72fca7a640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f72f80b1ef0 0x7f72f80b45c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:60904/0 (socket says 172.21.15.130:60904) 2024-06-11T17:33:32.029 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.029+0000 7f72fca7a640 1 -- 172.21.15.130:0/3799237773 learned_addr learned my addr 172.21.15.130:0/3799237773 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-06-11T17:33:32.030 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.029+0000 7f72fd27b640 1 --2- 172.21.15.130:0/3799237773 >> v2:172.21.15.172:3300/0 conn(0x7f72f80b53c0 0x7f72f80b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:32.030 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.029+0000 7f72effff640 1 -- 172.21.15.130:0/3799237773 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 47607074 0 0) 0x7f72f8142cb0 con 0x7f72f80b1ef0 2024-06-11T17:33:32.030 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.029+0000 7f72effff640 1 -- 172.21.15.130:0/3799237773 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72e4003530 con 0x7f72f80b1ef0 2024-06-11T17:33:32.030 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.029+0000 7f72effff640 1 -- 172.21.15.130:0/3799237773 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1849017673 0 0) 0x7f72e4003530 con 0x7f72f80b1ef0 2024-06-11T17:33:32.030 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.029+0000 7f72effff640 1 -- 172.21.15.130:0/3799237773 >> v2:172.21.15.172:3300/0 conn(0x7f72f80b53c0 msgr2=0x7f72f80b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:33:32.030 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.029+0000 7f72effff640 1 --2- 172.21.15.130:0/3799237773 >> v2:172.21.15.172:3300/0 conn(0x7f72f80b53c0 0x7f72f80b19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:32.030 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.029+0000 7f72effff640 1 -- 172.21.15.130:0/3799237773 >> v1:172.21.15.172:6789/0 conn(0x7f72f80b4cd0 legacy=0x7f72f814d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:32.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.029+0000 7f72effff640 1 -- 172.21.15.130:0/3799237773 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f80aaa50 con 0x7f72f80b1ef0 2024-06-11T17:33:32.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.029+0000 7f72effff640 1 -- 172.21.15.130:0/3799237773 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3158545239 0 0) 0x7f72e8001700 con 0x7f72f80b1ef0 2024-06-11T17:33:32.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.029+0000 7f72effff640 1 -- 172.21.15.130:0/3799237773 >> v1:172.21.15.130:6789/0 conn(0x7f72f80b1ef0 legacy=0x7f72f80b45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:32.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.029+0000 7f72effff640 1 --2- 172.21.15.130:0/3799237773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72e4003a60 0x7f72e4003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:32.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.029+0000 7f72effff640 1 --2- 172.21.15.130:0/3799237773 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72e4004810 0x7f72e4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:32.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.029+0000 7f72effff640 1 --2- 172.21.15.130:0/3799237773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72e40051d0 0x7f72e400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:32.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.029+0000 7f72effff640 1 -- 172.21.15.130:0/3799237773 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f72f80b3000 con 0x7f72e40051d0 2024-06-11T17:33:32.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.029+0000 7f72effff640 1 -- 172.21.15.130:0/3799237773 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f72e400c170 con 0x7f72e4003a60 2024-06-11T17:33:32.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.029+0000 7f72effff640 1 -- 172.21.15.130:0/3799237773 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f72e400c370 con 0x7f72e4004810 2024-06-11T17:33:32.032 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.029+0000 7f72fda7c640 1 --2- 172.21.15.130:0/3799237773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72e40051d0 0x7f72e400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:32.032 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.029+0000 7f72fca7a640 1 --2- 172.21.15.130:0/3799237773 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72e4004810 0x7f72e4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:32.032 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.029+0000 7f72fd27b640 1 --2- 172.21.15.130:0/3799237773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72e4003a60 0x7f72e4003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:32.032 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.029+0000 7f72fda7c640 1 -- 172.21.15.130:0/3799237773 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72e4004810 msgr2=0x7f72e4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:33:32.032 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.029+0000 7f72fda7c640 1 --2- 172.21.15.130:0/3799237773 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72e4004810 0x7f72e4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:32.032 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.029+0000 7f72fda7c640 1 -- 172.21.15.130:0/3799237773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72e4003a60 msgr2=0x7f72e4003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:33:32.032 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.029+0000 7f72fda7c640 1 --2- 172.21.15.130:0/3799237773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72e4003a60 0x7f72e4003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:32.032 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.029+0000 7f72fda7c640 1 -- 172.21.15.130:0/3799237773 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72e4003530 con 0x7f72e40051d0 2024-06-11T17:33:32.032 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.029+0000 7f72fd27b640 1 --2- 172.21.15.130:0/3799237773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72e4003a60 0x7f72e4003e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-11T17:33:32.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72fda7c640 1 -- 172.21.15.130:0/3799237773 reap_dead start 2024-06-11T17:33:32.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72fda7c640 1 --2- 172.21.15.130:0/3799237773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72e40051d0 0x7f72e400b9d0 secure :-1 s=READY pgs=4075 cs=0 l=1 rev1=1 crypto rx=0x7f72f0001e90 tx=0x7f72f001c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80d36f36ef0958f0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:32.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72effff640 1 -- 172.21.15.130:0/3799237773 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f0001ae0 con 0x7f72e40051d0 2024-06-11T17:33:32.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72effff640 1 -- 172.21.15.130:0/3799237773 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f0003b80 con 0x7f72e40051d0 2024-06-11T17:33:32.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72effff640 1 -- 172.21.15.130:0/3799237773 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f00050d0 con 0x7f72e40051d0 2024-06-11T17:33:32.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72ff4df640 1 -- 172.21.15.130:0/3799237773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72e40051d0 msgr2=0x7f72e400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:32.037 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72ff4df640 1 --2- 172.21.15.130:0/3799237773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72e40051d0 0x7f72e400b9d0 secure :-1 s=READY pgs=4075 cs=0 l=1 rev1=1 crypto rx=0x7f72f0001e90 tx=0x7f72f001c750 comp rx=0 tx=0).stop 2024-06-11T17:33:32.037 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72ff4df640 1 -- 172.21.15.130:0/3799237773 shutdown_connections 2024-06-11T17:33:32.037 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72ff4df640 1 --2- 172.21.15.130:0/3799237773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72e40051d0 0x7f72e400b9d0 unknown :-1 s=CLOSED pgs=4075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:32.037 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72ff4df640 1 -- 172.21.15.130:0/3799237773 >> 172.21.15.130:0/3799237773 conn(0x7f72f80634f0 msgr2=0x7f72f806dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:32.037 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72ff4df640 1 -- 172.21.15.130:0/3799237773 shutdown_connections 2024-06-11T17:33:32.037 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72ff4df640 1 -- 172.21.15.130:0/3799237773 wait complete. 2024-06-11T17:33:32.037 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72ff4df640 1 Processor -- start 2024-06-11T17:33:32.037 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72ff4df640 1 -- start start 2024-06-11T17:33:32.038 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72ff4df640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72e40051d0 0x7f72f8145e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:32.038 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72ff4df640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72f80ae340 0x7f72f81d7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:32.038 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72ff4df640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72f81d8070 0x7f72f813ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:32.038 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72ff4df640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f72f80b5920 con 0x7f72f80ae340 2024-06-11T17:33:32.038 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72ff4df640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f72f80b57a0 con 0x7f72f81d8070 2024-06-11T17:33:32.038 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72ff4df640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f72f80b5aa0 con 0x7f72e40051d0 2024-06-11T17:33:32.038 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72fd27b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72e40051d0 0x7f72f8145e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:32.038 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72fca7a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72f80ae340 0x7f72f81d7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:32.039 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72fd27b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72e40051d0 0x7f72f8145e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:35376/0 (socket says 172.21.15.130:35376) 2024-06-11T17:33:32.039 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72fca7a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72f80ae340 0x7f72f81d7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:55118/0 (socket says 172.21.15.130:55118) 2024-06-11T17:33:32.039 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72fd27b640 1 -- 172.21.15.130:0/3212510220 learned_addr learned my addr 172.21.15.130:0/3212510220 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:33:32.039 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72fda7c640 1 --2- 172.21.15.130:0/3212510220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72f81d8070 0x7f72f813ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:32.039 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72fd27b640 1 -- 172.21.15.130:0/3212510220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72f81d8070 msgr2=0x7f72f813ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:32.039 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72fd27b640 1 --2- 172.21.15.130:0/3212510220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72f81d8070 0x7f72f813ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:32.039 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72fd27b640 1 -- 172.21.15.130:0/3212510220 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72f80ae340 msgr2=0x7f72f81d7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:32.039 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72fd27b640 1 --2- 172.21.15.130:0/3212510220 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72f80ae340 0x7f72f81d7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:32.039 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72fd27b640 1 -- 172.21.15.130:0/3212510220 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f80af9d0 con 0x7f72e40051d0 2024-06-11T17:33:32.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72fca7a640 1 --2- 172.21.15.130:0/3212510220 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72f80ae340 0x7f72f81d7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:33:32.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72fda7c640 1 --2- 172.21.15.130:0/3212510220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72f81d8070 0x7f72f813ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-11T17:33:32.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72fd27b640 1 --2- 172.21.15.130:0/3212510220 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72e40051d0 0x7f72f8145e70 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 crypto rx=0x7f72f4010930 tx=0x7f72f4010df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:32.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72edffb640 1 -- 172.21.15.130:0/3212510220 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f400f040 con 0x7f72e40051d0 2024-06-11T17:33:32.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72edffb640 1 -- 172.21.15.130:0/3212510220 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f4004220 con 0x7f72e40051d0 2024-06-11T17:33:32.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72ff4df640 1 -- 172.21.15.130:0/3212510220 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72f80ad9f0 con 0x7f72e40051d0 2024-06-11T17:33:32.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72edffb640 1 -- 172.21.15.130:0/3212510220 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f400e9c0 con 0x7f72e40051d0 2024-06-11T17:33:32.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.033+0000 7f72ff4df640 1 -- 172.21.15.130:0/3212510220 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f72f80adf10 con 0x7f72e40051d0 2024-06-11T17:33:32.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.037+0000 7f72ff4df640 1 -- 172.21.15.130:0/3212510220 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72f80ad820 con 0x7f72e40051d0 2024-06-11T17:33:32.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.037+0000 7f72edffb640 1 -- 172.21.15.130:0/3212510220 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f72f400eb60 con 0x7f72e40051d0 2024-06-11T17:33:32.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.037+0000 7f72edffb640 1 --2- 172.21.15.130:0/3212510220 >> v2:172.21.15.130:6816/3863300924 conn(0x7f72dc070d90 0x7f72dc073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:32.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.037+0000 7f72edffb640 1 -- 172.21.15.130:0/3212510220 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(702..702 src has 449..702) ==== 5253+0+0 (secure 0 0 0) 0x7f72f4091170 con 0x7f72e40051d0 2024-06-11T17:33:32.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.037+0000 7f72fca7a640 1 --2- 172.21.15.130:0/3212510220 >> v2:172.21.15.130:6816/3863300924 conn(0x7f72dc070d90 0x7f72dc073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:32.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.037+0000 7f72fca7a640 1 --2- 172.21.15.130:0/3212510220 >> v2:172.21.15.130:6816/3863300924 conn(0x7f72dc070d90 0x7f72dc073250 secure :-1 s=READY pgs=3455 cs=0 l=1 rev1=1 crypto rx=0x7f72f8146650 tx=0x7f72e8007900 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:32.042 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.041+0000 7f72edffb640 1 -- 172.21.15.130:0/3212510220 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7f72f4018030 con 0x7f72e40051d0 2024-06-11T17:33:32.190 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.189+0000 7f72ff4df640 1 -- 172.21.15.130:0/3212510220 --> v2:172.21.15.130:6816/3863300924 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f72f81d8450 con 0x7f72dc070d90 2024-06-11T17:33:32.193 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.193+0000 7f72edffb640 1 -- 172.21.15.130:0/3212510220 <== mgr.4107 v2:172.21.15.130:6816/3863300924 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+115953 (secure 0 0 0) 0x7f72f81d8450 con 0x7f72dc070d90 2024-06-11T17:33:32.194 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:33:32.195 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2024-06-11T17:33:32.196 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.197+0000 7f72ff4df640 1 -- 172.21.15.130:0/3212510220 >> v2:172.21.15.130:6816/3863300924 conn(0x7f72dc070d90 msgr2=0x7f72dc073250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:32.196 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.197+0000 7f72ff4df640 1 --2- 172.21.15.130:0/3212510220 >> v2:172.21.15.130:6816/3863300924 conn(0x7f72dc070d90 0x7f72dc073250 secure :-1 s=READY pgs=3455 cs=0 l=1 rev1=1 crypto rx=0x7f72f8146650 tx=0x7f72e8007900 comp rx=0 tx=0).stop 2024-06-11T17:33:32.196 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.197+0000 7f72ff4df640 1 -- 172.21.15.130:0/3212510220 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72e40051d0 msgr2=0x7f72f8145e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:32.197 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.197+0000 7f72ff4df640 1 --2- 172.21.15.130:0/3212510220 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72e40051d0 0x7f72f8145e70 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 crypto rx=0x7f72f4010930 tx=0x7f72f4010df0 comp rx=0 tx=0).stop 2024-06-11T17:33:32.197 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.197+0000 7f72ff4df640 1 -- 172.21.15.130:0/3212510220 shutdown_connections 2024-06-11T17:33:32.197 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.197+0000 7f72ff4df640 1 --2- 172.21.15.130:0/3212510220 >> v2:172.21.15.130:6816/3863300924 conn(0x7f72dc070d90 0x7f72dc073250 unknown :-1 s=CLOSED pgs=3455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:32.197 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.197+0000 7f72ff4df640 1 --2- 172.21.15.130:0/3212510220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72f81d8070 0x7f72f813ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:32.197 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.197+0000 7f72ff4df640 1 --2- 172.21.15.130:0/3212510220 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72f80ae340 0x7f72f81d7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:32.197 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.197+0000 7f72ff4df640 1 --2- 172.21.15.130:0/3212510220 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72e40051d0 0x7f72f8145e70 unknown :-1 s=CLOSED pgs=2324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:32.197 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.197+0000 7f72ff4df640 1 -- 172.21.15.130:0/3212510220 >> 172.21.15.130:0/3212510220 conn(0x7f72f80634f0 msgr2=0x7f72f813f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:32.197 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.197+0000 7f72ff4df640 1 -- 172.21.15.130:0/3212510220 shutdown_connections 2024-06-11T17:33:32.198 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:32.197+0000 7f72ff4df640 1 -- 172.21.15.130:0/3212510220 wait complete. 2024-06-11T17:33:32.211 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":1152,"stamp":"2024-06-11T17:33:31.163601+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590373,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":61,"num_write":108,"num_write_kb":1635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":604560,"kb_used_data":71864,"kb_used_omap":12,"kb_used_meta":532531,"kb_avail":754370160,"statfs":{"total":773094113280,"available":772475043840,"internally_reserved":0,"allocated":73588736,"data_stored":38129138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":545312306},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.871682"},"pg_stats":[{"pgid":"8.18","version":"0'0","reported_seq":1356,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:25.316049+0000","last_change":"2024-06-11T17:19:20.252042+0000","last_active":"2024-06-11T17:33:25.316049+0000","last_peered":"2024-06-11T17:33:25.316049+0000","last_clean":"2024-06-11T17:33:25.316049+0000","last_became_active":"2024-06-11T17:19:20.245039+0000","last_became_peered":"2024-06-11T17:19:20.245039+0000","last_unstale":"2024-06-11T17:33:25.316049+0000","last_undegraded":"2024-06-11T17:33:25.316049+0000","last_fullsized":"2024-06-11T17:33:25.316049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:37.254125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1354,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:25.464318+0000","last_change":"2024-06-11T17:19:20.146092+0000","last_active":"2024-06-11T17:33:25.464318+0000","last_peered":"2024-06-11T17:33:25.464318+0000","last_clean":"2024-06-11T17:33:25.464318+0000","last_became_active":"2024-06-11T17:19:20.143262+0000","last_became_peered":"2024-06-11T17:19:20.143262+0000","last_unstale":"2024-06-11T17:33:25.464318+0000","last_undegraded":"2024-06-11T17:33:25.464318+0000","last_fullsized":"2024-06-11T17:33:25.464318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:24:15.418401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1351,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:25.312644+0000","last_change":"2024-06-11T17:19:20.166997+0000","last_active":"2024-06-11T17:33:25.312644+0000","last_peered":"2024-06-11T17:33:25.312644+0000","last_clean":"2024-06-11T17:33:25.312644+0000","last_became_active":"2024-06-11T17:19:20.165147+0000","last_became_peered":"2024-06-11T17:19:20.165147+0000","last_unstale":"2024-06-11T17:33:25.312644+0000","last_undegraded":"2024-06-11T17:33:25.312644+0000","last_fullsized":"2024-06-11T17:33:25.312644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1356,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:25.316122+0000","last_change":"2024-06-11T17:19:20.204932+0000","last_active":"2024-06-11T17:33:25.316122+0000","last_peered":"2024-06-11T17:33:25.316122+0000","last_clean":"2024-06-11T17:33:25.316122+0000","last_became_active":"2024-06-11T17:19:20.204104+0000","last_became_peered":"2024-06-11T17:19:20.204104+0000","last_unstale":"2024-06-11T17:33:25.316122+0000","last_undegraded":"2024-06-11T17:33:25.316122+0000","last_fullsized":"2024-06-11T17:33:25.316122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:22:09.289002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1354,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:25.464719+0000","last_change":"2024-06-11T17:19:20.142647+0000","last_active":"2024-06-11T17:33:25.464719+0000","last_peered":"2024-06-11T17:33:25.464719+0000","last_clean":"2024-06-11T17:33:25.464719+0000","last_became_active":"2024-06-11T17:19:20.141398+0000","last_became_peered":"2024-06-11T17:19:20.141398+0000","last_unstale":"2024-06-11T17:33:25.464719+0000","last_undegraded":"2024-06-11T17:33:25.464719+0000","last_fullsized":"2024-06-11T17:33:25.464719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:37:49.933084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1349,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:26.397303+0000","last_change":"2024-06-11T17:19:20.195776+0000","last_active":"2024-06-11T17:33:26.397303+0000","last_peered":"2024-06-11T17:33:26.397303+0000","last_clean":"2024-06-11T17:33:26.397303+0000","last_became_active":"2024-06-11T17:19:20.192892+0000","last_became_peered":"2024-06-11T17:19:20.192892+0000","last_unstale":"2024-06-11T17:33:26.397303+0000","last_undegraded":"2024-06-11T17:33:26.397303+0000","last_fullsized":"2024-06-11T17:33:26.397303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T05:17:41.998549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1352,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:25.313580+0000","last_change":"2024-06-11T17:19:20.175472+0000","last_active":"2024-06-11T17:33:25.313580+0000","last_peered":"2024-06-11T17:33:25.313580+0000","last_clean":"2024-06-11T17:33:25.313580+0000","last_became_active":"2024-06-11T17:19:20.175221+0000","last_became_peered":"2024-06-11T17:19:20.175221+0000","last_unstale":"2024-06-11T17:33:25.313580+0000","last_undegraded":"2024-06-11T17:33:25.313580+0000","last_fullsized":"2024-06-11T17:33:25.313580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1347,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:25.441904+0000","last_change":"2024-06-11T17:19:20.121498+0000","last_active":"2024-06-11T17:33:25.441904+0000","last_peered":"2024-06-11T17:33:25.441904+0000","last_clean":"2024-06-11T17:33:25.441904+0000","last_became_active":"2024-06-11T17:19:20.120302+0000","last_became_peered":"2024-06-11T17:19:20.120302+0000","last_unstale":"2024-06-11T17:33:25.441904+0000","last_undegraded":"2024-06-11T17:33:25.441904+0000","last_fullsized":"2024-06-11T17:33:25.441904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T05:14:47.533955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1378,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:25.313200+0000","last_change":"2024-06-11T17:19:20.243500+0000","last_active":"2024-06-11T17:33:25.313200+0000","last_peered":"2024-06-11T17:33:25.313200+0000","last_clean":"2024-06-11T17:33:25.313200+0000","last_became_active":"2024-06-11T17:19:20.243122+0000","last_became_peered":"2024-06-11T17:19:20.243122+0000","last_unstale":"2024-06-11T17:33:25.313200+0000","last_undegraded":"2024-06-11T17:33:25.313200+0000","last_fullsized":"2024-06-11T17:33:25.313200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:11:13.381933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1","version":"19'7","reported_seq":1360,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:25.441686+0000","last_change":"2024-06-11T17:19:20.192244+0000","last_active":"2024-06-11T17:33:25.441686+0000","last_peered":"2024-06-11T17:33:25.441686+0000","last_clean":"2024-06-11T17:33:25.441686+0000","last_became_active":"2024-06-11T17:19:20.191981+0000","last_became_peered":"2024-06-11T17:19:20.191981+0000","last_unstale":"2024-06-11T17:33:25.441686+0000","last_undegraded":"2024-06-11T17:33:25.441686+0000","last_fullsized":"2024-06-11T17:33:25.441686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:25:30.923332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1357,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:25.316059+0000","last_change":"2024-06-11T17:19:20.255611+0000","last_active":"2024-06-11T17:33:25.316059+0000","last_peered":"2024-06-11T17:33:25.316059+0000","last_clean":"2024-06-11T17:33:25.316059+0000","last_became_active":"2024-06-11T17:19:20.247875+0000","last_became_peered":"2024-06-11T17:19:20.247875+0000","last_unstale":"2024-06-11T17:33:25.316059+0000","last_undegraded":"2024-06-11T17:33:25.316059+0000","last_fullsized":"2024-06-11T17:33:25.316059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:31:10.443876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1347,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:25.441754+0000","last_change":"2024-06-11T17:19:20.250335+0000","last_active":"2024-06-11T17:33:25.441754+0000","last_peered":"2024-06-11T17:33:25.441754+0000","last_clean":"2024-06-11T17:33:25.441754+0000","last_became_active":"2024-06-11T17:19:20.250080+0000","last_became_peered":"2024-06-11T17:19:20.250080+0000","last_unstale":"2024-06-11T17:33:25.441754+0000","last_undegraded":"2024-06-11T17:33:25.441754+0000","last_fullsized":"2024-06-11T17:33:25.441754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:14:17.864074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":1439,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:26.396939+0000","last_change":"2024-06-11T17:18:20.659416+0000","last_active":"2024-06-11T17:33:26.396939+0000","last_peered":"2024-06-11T17:33:26.396939+0000","last_clean":"2024-06-11T17:33:26.396939+0000","last_became_active":"2024-06-11T17:18:20.657407+0000","last_became_peered":"2024-06-11T17:18:20.657407+0000","last_unstale":"2024-06-11T17:33:26.396939+0000","last_undegraded":"2024-06-11T17:33:26.396939+0000","last_fullsized":"2024-06-11T17:33:26.396939+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:15:37.551739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1362,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:25.464608+0000","last_change":"2024-06-11T17:18:20.575928+0000","last_active":"2024-06-11T17:33:25.464608+0000","last_peered":"2024-06-11T17:33:25.464608+0000","last_clean":"2024-06-11T17:33:25.464608+0000","last_became_active":"2024-06-11T17:18:20.575356+0000","last_became_peered":"2024-06-11T17:18:20.575356+0000","last_unstale":"2024-06-11T17:33:25.464608+0000","last_undegraded":"2024-06-11T17:33:25.464608+0000","last_fullsized":"2024-06-11T17:33:25.464608+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:57:32.714496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1349,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:26.396921+0000","last_change":"2024-06-11T17:19:20.247282+0000","last_active":"2024-06-11T17:33:26.396921+0000","last_peered":"2024-06-11T17:33:26.396921+0000","last_clean":"2024-06-11T17:33:26.396921+0000","last_became_active":"2024-06-11T17:19:20.238515+0000","last_became_peered":"2024-06-11T17:19:20.238515+0000","last_unstale":"2024-06-11T17:33:26.396921+0000","last_undegraded":"2024-06-11T17:33:26.396921+0000","last_fullsized":"2024-06-11T17:33:26.396921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:58:29.983143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1349,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:26.397293+0000","last_change":"2024-06-11T17:18:20.576662+0000","last_active":"2024-06-11T17:33:26.397293+0000","last_peered":"2024-06-11T17:33:26.397293+0000","last_clean":"2024-06-11T17:33:26.397293+0000","last_became_active":"2024-06-11T17:18:20.575851+0000","last_became_peered":"2024-06-11T17:18:20.575851+0000","last_unstale":"2024-06-11T17:33:26.397293+0000","last_undegraded":"2024-06-11T17:33:26.397293+0000","last_fullsized":"2024-06-11T17:33:26.397293+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:49:51.271037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1347,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:25.441720+0000","last_change":"2024-06-11T17:19:20.111865+0000","last_active":"2024-06-11T17:33:25.441720+0000","last_peered":"2024-06-11T17:33:25.441720+0000","last_clean":"2024-06-11T17:33:25.441720+0000","last_became_active":"2024-06-11T17:19:20.106199+0000","last_became_peered":"2024-06-11T17:19:20.106199+0000","last_unstale":"2024-06-11T17:33:25.441720+0000","last_undegraded":"2024-06-11T17:33:25.441720+0000","last_fullsized":"2024-06-11T17:33:25.441720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:03:31.736728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1368,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:25.892057+0000","last_change":"2024-06-11T17:18:20.572075+0000","last_active":"2024-06-11T17:33:25.892057+0000","last_peered":"2024-06-11T17:33:25.892057+0000","last_clean":"2024-06-11T17:33:25.892057+0000","last_became_active":"2024-06-11T17:18:20.571627+0000","last_became_peered":"2024-06-11T17:18:20.571627+0000","last_unstale":"2024-06-11T17:33:25.892057+0000","last_undegraded":"2024-06-11T17:33:25.892057+0000","last_fullsized":"2024-06-11T17:33:25.892057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:15:20.179876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1377,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:25.313280+0000","last_change":"2024-06-11T17:19:20.205257+0000","last_active":"2024-06-11T17:33:25.313280+0000","last_peered":"2024-06-11T17:33:25.313280+0000","last_clean":"2024-06-11T17:33:25.313280+0000","last_became_active":"2024-06-11T17:19:20.205013+0000","last_became_peered":"2024-06-11T17:19:20.205013+0000","last_unstale":"2024-06-11T17:33:25.313280+0000","last_undegraded":"2024-06-11T17:33:25.313280+0000","last_fullsized":"2024-06-11T17:33:25.313280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:28:05.365948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1362,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:25.464367+0000","last_change":"2024-06-11T17:18:20.576498+0000","last_active":"2024-06-11T17:33:25.464367+0000","last_peered":"2024-06-11T17:33:25.464367+0000","last_clean":"2024-06-11T17:33:25.464367+0000","last_became_active":"2024-06-11T17:18:20.575917+0000","last_became_peered":"2024-06-11T17:18:20.575917+0000","last_unstale":"2024-06-11T17:33:25.464367+0000","last_undegraded":"2024-06-11T17:33:25.464367+0000","last_fullsized":"2024-06-11T17:33:25.464367+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:41:38.453105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1355,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:25.464218+0000","last_change":"2024-06-11T17:19:20.256793+0000","last_active":"2024-06-11T17:33:25.464218+0000","last_peered":"2024-06-11T17:33:25.464218+0000","last_clean":"2024-06-11T17:33:25.464218+0000","last_became_active":"2024-06-11T17:19:20.256125+0000","last_became_peered":"2024-06-11T17:19:20.256125+0000","last_unstale":"2024-06-11T17:33:25.464218+0000","last_undegraded":"2024-06-11T17:33:25.464218+0000","last_fullsized":"2024-06-11T17:33:25.464218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:49:16.819595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1354,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:25.441726+0000","last_change":"2024-06-11T17:18:20.656553+0000","last_active":"2024-06-11T17:33:25.441726+0000","last_peered":"2024-06-11T17:33:25.441726+0000","last_clean":"2024-06-11T17:33:25.441726+0000","last_became_active":"2024-06-11T17:18:20.656011+0000","last_became_peered":"2024-06-11T17:18:20.656011+0000","last_unstale":"2024-06-11T17:33:25.441726+0000","last_undegraded":"2024-06-11T17:33:25.441726+0000","last_fullsized":"2024-06-11T17:33:25.441726+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:10:47.950547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1352,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:25.313458+0000","last_change":"2024-06-11T17:19:20.131816+0000","last_active":"2024-06-11T17:33:25.313458+0000","last_peered":"2024-06-11T17:33:25.313458+0000","last_clean":"2024-06-11T17:33:25.313458+0000","last_became_active":"2024-06-11T17:19:20.129276+0000","last_became_peered":"2024-06-11T17:19:20.129276+0000","last_unstale":"2024-06-11T17:33:25.313458+0000","last_undegraded":"2024-06-11T17:33:25.313458+0000","last_fullsized":"2024-06-11T17:33:25.313458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1349,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:26.397966+0000","last_change":"2024-06-11T17:18:20.659201+0000","last_active":"2024-06-11T17:33:26.397966+0000","last_peered":"2024-06-11T17:33:26.397966+0000","last_clean":"2024-06-11T17:33:26.397966+0000","last_became_active":"2024-06-11T17:18:20.658322+0000","last_became_peered":"2024-06-11T17:18:20.658322+0000","last_unstale":"2024-06-11T17:33:26.397966+0000","last_undegraded":"2024-06-11T17:33:26.397966+0000","last_fullsized":"2024-06-11T17:33:26.397966+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T05:15:44.549344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1377,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:25.313483+0000","last_change":"2024-06-11T17:19:20.211466+0000","last_active":"2024-06-11T17:33:25.313483+0000","last_peered":"2024-06-11T17:33:25.313483+0000","last_clean":"2024-06-11T17:33:25.313483+0000","last_became_active":"2024-06-11T17:19:20.206654+0000","last_became_peered":"2024-06-11T17:19:20.206654+0000","last_unstale":"2024-06-11T17:33:25.313483+0000","last_undegraded":"2024-06-11T17:33:25.313483+0000","last_fullsized":"2024-06-11T17:33:25.313483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:07:31.495499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1354,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:25.441962+0000","last_change":"2024-06-11T17:18:20.573579+0000","last_active":"2024-06-11T17:33:25.441962+0000","last_peered":"2024-06-11T17:33:25.441962+0000","last_clean":"2024-06-11T17:33:25.441962+0000","last_became_active":"2024-06-11T17:18:20.573196+0000","last_became_peered":"2024-06-11T17:18:20.573196+0000","last_unstale":"2024-06-11T17:33:25.441962+0000","last_undegraded":"2024-06-11T17:33:25.441962+0000","last_fullsized":"2024-06-11T17:33:25.441962+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:32:09.705134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1360,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:28.785310+0000","last_change":"2024-06-11T17:33:28.785335+0000","last_active":"2024-06-11T17:33:28.785310+0000","last_peered":"2024-06-11T17:33:28.785310+0000","last_clean":"2024-06-11T17:33:28.785310+0000","last_became_active":"2024-06-11T17:19:20.099516+0000","last_became_peered":"2024-06-11T17:19:20.099516+0000","last_unstale":"2024-06-11T17:33:28.785310+0000","last_undegraded":"2024-06-11T17:33:28.785310+0000","last_fullsized":"2024-06-11T17:33:28.785310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:28.785221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:28.785221+0000","last_clean_scrub_stamp":"2024-06-11T17:33:28.785221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:59:12.301900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1355,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:26.397081+0000","last_change":"2024-06-11T17:18:20.575070+0000","last_active":"2024-06-11T17:33:26.397081+0000","last_peered":"2024-06-11T17:33:26.397081+0000","last_clean":"2024-06-11T17:33:26.397081+0000","last_became_active":"2024-06-11T17:18:20.574485+0000","last_became_peered":"2024-06-11T17:18:20.574485+0000","last_unstale":"2024-06-11T17:33:26.397081+0000","last_undegraded":"2024-06-11T17:33:26.397081+0000","last_fullsized":"2024-06-11T17:33:26.397081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:18:19.552929+0000","last_clean_scrub_stamp":"2024-06-11T17:18:19.552929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:57.544403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1355,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:25.464574+0000","last_change":"2024-06-11T17:19:20.217640+0000","last_active":"2024-06-11T17:33:25.464574+0000","last_peered":"2024-06-11T17:33:25.464574+0000","last_clean":"2024-06-11T17:33:25.464574+0000","last_became_active":"2024-06-11T17:19:20.216412+0000","last_became_peered":"2024-06-11T17:19:20.216412+0000","last_unstale":"2024-06-11T17:33:25.464574+0000","last_undegraded":"2024-06-11T17:33:25.464574+0000","last_fullsized":"2024-06-11T17:33:25.464574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:37:52.624679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1352,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:25.313794+0000","last_change":"2024-06-11T17:19:20.160954+0000","last_active":"2024-06-11T17:33:25.313794+0000","last_peered":"2024-06-11T17:33:25.313794+0000","last_clean":"2024-06-11T17:33:25.313794+0000","last_became_active":"2024-06-11T17:19:20.148798+0000","last_became_peered":"2024-06-11T17:19:20.148798+0000","last_unstale":"2024-06-11T17:33:25.313794+0000","last_undegraded":"2024-06-11T17:33:25.313794+0000","last_fullsized":"2024-06-11T17:33:25.313794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1378,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:25.313488+0000","last_change":"2024-06-11T17:19:20.127532+0000","last_active":"2024-06-11T17:33:25.313488+0000","last_peered":"2024-06-11T17:33:25.313488+0000","last_clean":"2024-06-11T17:33:25.313488+0000","last_became_active":"2024-06-11T17:19:20.125396+0000","last_became_peered":"2024-06-11T17:19:20.125396+0000","last_unstale":"2024-06-11T17:33:25.313488+0000","last_undegraded":"2024-06-11T17:33:25.313488+0000","last_fullsized":"2024-06-11T17:33:25.313488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:13:54.402896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1351,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:25.313060+0000","last_change":"2024-06-11T17:19:20.227383+0000","last_active":"2024-06-11T17:33:25.313060+0000","last_peered":"2024-06-11T17:33:25.313060+0000","last_clean":"2024-06-11T17:33:25.313060+0000","last_became_active":"2024-06-11T17:19:20.226102+0000","last_became_peered":"2024-06-11T17:19:20.226102+0000","last_unstale":"2024-06-11T17:33:25.313060+0000","last_undegraded":"2024-06-11T17:33:25.313060+0000","last_fullsized":"2024-06-11T17:33:25.313060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1354,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:25.464656+0000","last_change":"2024-06-11T17:19:20.211934+0000","last_active":"2024-06-11T17:33:25.464656+0000","last_peered":"2024-06-11T17:33:25.464656+0000","last_clean":"2024-06-11T17:33:25.464656+0000","last_became_active":"2024-06-11T17:19:20.211650+0000","last_became_peered":"2024-06-11T17:19:20.211650+0000","last_unstale":"2024-06-11T17:33:25.464656+0000","last_undegraded":"2024-06-11T17:33:25.464656+0000","last_fullsized":"2024-06-11T17:33:25.464656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:53:48.110520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1377,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:25.313214+0000","last_change":"2024-06-11T17:19:20.093172+0000","last_active":"2024-06-11T17:33:25.313214+0000","last_peered":"2024-06-11T17:33:25.313214+0000","last_clean":"2024-06-11T17:33:25.313214+0000","last_became_active":"2024-06-11T17:19:20.092900+0000","last_became_peered":"2024-06-11T17:19:20.092900+0000","last_unstale":"2024-06-11T17:33:25.313214+0000","last_undegraded":"2024-06-11T17:33:25.313214+0000","last_fullsized":"2024-06-11T17:33:25.313214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:00:19.896831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1349,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:26.396964+0000","last_change":"2024-06-11T17:19:20.164400+0000","last_active":"2024-06-11T17:33:26.396964+0000","last_peered":"2024-06-11T17:33:26.396964+0000","last_clean":"2024-06-11T17:33:26.396964+0000","last_became_active":"2024-06-11T17:19:20.164153+0000","last_became_peered":"2024-06-11T17:19:20.164153+0000","last_unstale":"2024-06-11T17:33:26.396964+0000","last_undegraded":"2024-06-11T17:33:26.396964+0000","last_fullsized":"2024-06-11T17:33:26.396964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:47:00.884490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1355,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:25.464449+0000","last_change":"2024-06-11T17:19:20.217817+0000","last_active":"2024-06-11T17:33:25.464449+0000","last_peered":"2024-06-11T17:33:25.464449+0000","last_clean":"2024-06-11T17:33:25.464449+0000","last_became_active":"2024-06-11T17:19:20.211450+0000","last_became_peered":"2024-06-11T17:19:20.211450+0000","last_unstale":"2024-06-11T17:33:25.464449+0000","last_undegraded":"2024-06-11T17:33:25.464449+0000","last_fullsized":"2024-06-11T17:33:25.464449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:44:15.159723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1342,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:26.397472+0000","last_change":"2024-06-11T17:19:20.166503+0000","last_active":"2024-06-11T17:33:26.397472+0000","last_peered":"2024-06-11T17:33:26.397472+0000","last_clean":"2024-06-11T17:33:26.397472+0000","last_became_active":"2024-06-11T17:19:20.157763+0000","last_became_peered":"2024-06-11T17:19:20.157763+0000","last_unstale":"2024-06-11T17:33:26.397472+0000","last_undegraded":"2024-06-11T17:33:26.397472+0000","last_fullsized":"2024-06-11T17:33:26.397472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:07:50.951659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1341,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:26.397615+0000","last_change":"2024-06-11T17:19:20.180845+0000","last_active":"2024-06-11T17:33:26.397615+0000","last_peered":"2024-06-11T17:33:26.397615+0000","last_clean":"2024-06-11T17:33:26.397615+0000","last_became_active":"2024-06-11T17:19:20.180567+0000","last_became_peered":"2024-06-11T17:19:20.180567+0000","last_unstale":"2024-06-11T17:33:26.397615+0000","last_undegraded":"2024-06-11T17:33:26.397615+0000","last_fullsized":"2024-06-11T17:33:26.397615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:52:09.732771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1376,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:25.313620+0000","last_change":"2024-06-11T17:19:20.093495+0000","last_active":"2024-06-11T17:33:25.313620+0000","last_peered":"2024-06-11T17:33:25.313620+0000","last_clean":"2024-06-11T17:33:25.313620+0000","last_became_active":"2024-06-11T17:19:20.092534+0000","last_became_peered":"2024-06-11T17:19:20.092534+0000","last_unstale":"2024-06-11T17:33:25.313620+0000","last_undegraded":"2024-06-11T17:33:25.313620+0000","last_fullsized":"2024-06-11T17:33:25.313620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:57:08.203552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1341,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:26.397939+0000","last_change":"2024-06-11T17:19:20.221309+0000","last_active":"2024-06-11T17:33:26.397939+0000","last_peered":"2024-06-11T17:33:26.397939+0000","last_clean":"2024-06-11T17:33:26.397939+0000","last_became_active":"2024-06-11T17:19:20.212735+0000","last_became_peered":"2024-06-11T17:19:20.212735+0000","last_unstale":"2024-06-11T17:33:26.397939+0000","last_undegraded":"2024-06-11T17:33:26.397939+0000","last_fullsized":"2024-06-11T17:33:26.397939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:05:51.985748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1357,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:25.316192+0000","last_change":"2024-06-11T17:19:20.245137+0000","last_active":"2024-06-11T17:33:25.316192+0000","last_peered":"2024-06-11T17:33:25.316192+0000","last_clean":"2024-06-11T17:33:25.316192+0000","last_became_active":"2024-06-11T17:19:20.244248+0000","last_became_peered":"2024-06-11T17:19:20.244248+0000","last_unstale":"2024-06-11T17:33:25.316192+0000","last_undegraded":"2024-06-11T17:33:25.316192+0000","last_fullsized":"2024-06-11T17:33:25.316192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:19:18.945096+0000","last_clean_scrub_stamp":"2024-06-11T17:19:18.945096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:59:08.798157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542329,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72500,"kb_used_data":9372,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94299340,"statfs":{"total":96636764160,"available":96562524160,"internally_reserved":0,"allocated":9596928,"data_stored":5162837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":64616906},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542331,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71972,"kb_used_data":8852,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94299868,"statfs":{"total":96636764160,"available":96563064832,"internally_reserved":0,"allocated":9064448,"data_stored":4633909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542330,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84452,"kb_used_data":8852,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94287388,"statfs":{"total":96636764160,"available":96550285312,"internally_reserved":0,"allocated":9064448,"data_stored":4633909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542331,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71972,"kb_used_data":8852,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94299868,"statfs":{"total":96636764160,"available":96563064832,"internally_reserved":0,"allocated":9064448,"data_stored":4633909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542330,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72496,"kb_used_data":9376,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94299344,"statfs":{"total":96636764160,"available":96562528256,"internally_reserved":0,"allocated":9601024,"data_stored":5162842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575033,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84460,"kb_used_data":8852,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94287380,"statfs":{"total":96636764160,"available":96550277120,"internally_reserved":0,"allocated":9064448,"data_stored":4633909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575033,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62252,"kb_used_data":8852,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94309588,"statfs":{"total":96636764160,"available":96573018112,"internally_reserved":0,"allocated":9064448,"data_stored":4633909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575035,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84456,"kb_used_data":8856,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94287384,"statfs":{"total":96636764160,"available":96550281216,"internally_reserved":0,"allocated":9068544,"data_stored":4633914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-11T17:33:32.215 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-06-11T17:19:18.945096+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=19, tm_sec=18, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.216 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-06-11T17:19:18.945096+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=19, tm_sec=18, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.216 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-06-11T17:19:18.945096+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=19, tm_sec=18, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.216 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-06-11T17:19:18.945096+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=19, tm_sec=18, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.216 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-06-11T17:19:18.945096+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=19, tm_sec=18, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.216 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-06-11T17:19:18.945096+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=19, tm_sec=18, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.216 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-06-11T17:19:18.945096+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=19, tm_sec=18, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.217 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-06-11T17:19:18.945096+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=19, tm_sec=18, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.217 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-06-11T17:19:18.945096+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=19, tm_sec=18, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.217 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-06-11T17:19:18.945096+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=19, tm_sec=18, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.217 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-06-11T17:19:18.945096+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=19, tm_sec=18, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.217 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-06-11T17:19:18.945096+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=19, tm_sec=18, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.217 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-06-11T17:18:19.552929+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=18, tm_sec=19, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.218 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-06-11T17:18:19.552929+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=18, tm_sec=19, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.218 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-06-11T17:19:18.945096+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=19, tm_sec=18, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.218 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-06-11T17:18:19.552929+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=18, tm_sec=19, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.218 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-06-11T17:19:18.945096+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=19, tm_sec=18, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.218 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-06-11T17:18:19.552929+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=18, tm_sec=19, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.218 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-06-11T17:19:18.945096+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=19, tm_sec=18, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.219 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-06-11T17:18:19.552929+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=18, tm_sec=19, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.219 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-06-11T17:19:18.945096+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=19, tm_sec=18, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.219 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-06-11T17:18:19.552929+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=18, tm_sec=19, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.219 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-06-11T17:19:18.945096+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=19, tm_sec=18, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.219 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-06-11T17:18:19.552929+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=18, tm_sec=19, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.219 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-06-11T17:19:18.945096+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=19, tm_sec=18, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.220 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-06-11T17:18:19.552929+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=18, tm_sec=19, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.220 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-06-11T17:18:19.552929+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=18, tm_sec=19, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.220 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-06-11T17:19:18.945096+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=19, tm_sec=18, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.220 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-06-11T17:19:18.945096+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=19, tm_sec=18, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.220 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-06-11T17:19:18.945096+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=19, tm_sec=18, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.220 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-06-11T17:19:18.945096+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=19, tm_sec=18, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.220 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-06-11T17:19:18.945096+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=19, tm_sec=18, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.221 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-06-11T17:19:18.945096+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=19, tm_sec=18, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.221 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-06-11T17:19:18.945096+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=19, tm_sec=18, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.221 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-06-11T17:19:18.945096+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=19, tm_sec=18, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.221 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-06-11T17:19:18.945096+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=19, tm_sec=18, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.221 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-06-11T17:19:18.945096+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=19, tm_sec=18, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.221 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-06-11T17:19:18.945096+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=19, tm_sec=18, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.221 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-06-11T17:19:18.945096+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=19, tm_sec=18, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.222 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-06-11T17:19:18.945096+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=19, tm_sec=18, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=17, tm_min=33, tm_sec=27, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T17:33:32.222 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-06-11T17:33:52.223 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-11T17:33:52.366 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.368+0000 7f0fd1a5a640 1 Processor -- start 2024-06-11T17:33:52.367 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.368+0000 7f0fd1a5a640 1 -- start start 2024-06-11T17:33:52.368 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.368+0000 7f0fd1a5a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0fcc0af310 0x7f0fcc13f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:52.368 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.368+0000 7f0fd1a5a640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0fcc13d190 0x7f0fcc14a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:52.368 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.368+0000 7f0fd1a5a640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fcc0aca90 con 0x7f0fcc0ae6a0 2024-06-11T17:33:52.368 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.368+0000 7f0fd1a5a640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f0fcc0af6f0 con 0x7f0fcc13d190 2024-06-11T17:33:52.368 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.368+0000 7f0fd1a5a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f0fcc0ad920 con 0x7f0fcc0af310 2024-06-11T17:33:52.369 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.368+0000 7f0fcb7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0fcc13d190 0x7f0fcc14a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:52.369 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.368+0000 7f0fca7fc640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f0fcc0ae6a0 0x7f0fcc13ca80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:38154/0 (socket says 172.21.15.130:38154) 2024-06-11T17:33:52.369 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.368+0000 7f0fca7fc640 1 -- 172.21.15.130:0/2053991644 learned_addr learned my addr 172.21.15.130:0/2053991644 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-06-11T17:33:52.369 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.368+0000 7f0fcaffd640 1 --2- 172.21.15.130:0/2053991644 >> v2:172.21.15.172:3300/0 conn(0x7f0fcc0af310 0x7f0fcc13f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:52.369 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.368+0000 7f0fcb7fe640 1 -- 172.21.15.130:0/2053991644 >> v2:172.21.15.172:3300/0 conn(0x7f0fcc0af310 msgr2=0x7f0fcc13f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:33:52.369 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.368+0000 7f0fcb7fe640 1 --2- 172.21.15.130:0/2053991644 >> v2:172.21.15.172:3300/0 conn(0x7f0fcc0af310 0x7f0fcc13f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:52.369 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.368+0000 7f0fcb7fe640 1 -- 172.21.15.130:0/2053991644 >> v1:172.21.15.130:6789/0 conn(0x7f0fcc0ae6a0 legacy=0x7f0fcc13ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:52.369 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.368+0000 7f0fc9ffb640 1 -- 172.21.15.130:0/2053991644 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3753782973 0 0) 0x7f0fcc0aca90 con 0x7f0fcc0ae6a0 2024-06-11T17:33:52.369 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.368+0000 7f0fcb7fe640 1 -- 172.21.15.130:0/2053991644 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fcc0adc00 con 0x7f0fcc13d190 2024-06-11T17:33:52.370 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.368+0000 7f0fcaffd640 1 --2- 172.21.15.130:0/2053991644 >> v2:172.21.15.172:3300/0 conn(0x7f0fcc0af310 0x7f0fcc13f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-11T17:33:52.371 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.368+0000 7f0fcb7fe640 1 --2- 172.21.15.130:0/2053991644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fcc13d190 0x7f0fcc14a0f0 secure :-1 s=READY pgs=4077 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc0ae0f0 tx=0x7f0fc401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=744ca71ed7aeeb80 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:52.371 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.368+0000 7f0fc9ffb640 1 -- 172.21.15.130:0/2053991644 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc40b2070 con 0x7f0fcc13d190 2024-06-11T17:33:52.371 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.368+0000 7f0fc9ffb640 1 -- 172.21.15.130:0/2053991644 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fc40a5850 con 0x7f0fcc13d190 2024-06-11T17:33:52.371 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.368+0000 7f0fc9ffb640 1 -- 172.21.15.130:0/2053991644 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc40a5c20 con 0x7f0fcc13d190 2024-06-11T17:33:52.371 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fd1a5a640 1 -- 172.21.15.130:0/2053991644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fcc13d190 msgr2=0x7f0fcc14a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:52.371 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fd1a5a640 1 --2- 172.21.15.130:0/2053991644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fcc13d190 0x7f0fcc14a0f0 secure :-1 s=READY pgs=4077 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc0ae0f0 tx=0x7f0fc401c880 comp rx=0 tx=0).stop 2024-06-11T17:33:52.371 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fd1a5a640 1 -- 172.21.15.130:0/2053991644 shutdown_connections 2024-06-11T17:33:52.372 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fd1a5a640 1 --2- 172.21.15.130:0/2053991644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fcc13d190 0x7f0fcc14a0f0 unknown :-1 s=CLOSED pgs=4077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:52.372 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fd1a5a640 1 --2- 172.21.15.130:0/2053991644 >> v2:172.21.15.172:3300/0 conn(0x7f0fcc0af310 0x7f0fcc13f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:52.372 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fd1a5a640 1 -- 172.21.15.130:0/2053991644 >> 172.21.15.130:0/2053991644 conn(0x7f0fcc0b46b0 msgr2=0x7f0fcc0b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:52.372 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fd1a5a640 1 -- 172.21.15.130:0/2053991644 shutdown_connections 2024-06-11T17:33:52.372 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fd1a5a640 1 -- 172.21.15.130:0/2053991644 wait complete. 2024-06-11T17:33:52.374 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fd1a5a640 1 Processor -- start 2024-06-11T17:33:52.374 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fd1a5a640 1 -- start start 2024-06-11T17:33:52.374 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fd1a5a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0fcc0ae6a0 0x7f0fcc142820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:52.375 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fd1a5a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fcc0af310 0x7f0fcc13a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:52.375 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fd1a5a640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0fcc13d190 0x7f0fcc1d6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:52.375 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fd1a5a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0fcc0afd10 con 0x7f0fcc0af310 2024-06-11T17:33:52.375 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fd1a5a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0fcc0afb90 con 0x7f0fcc0ae6a0 2024-06-11T17:33:52.375 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fd1a5a640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f0fcc0afe90 con 0x7f0fcc13d190 2024-06-11T17:33:52.375 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fca7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fcc0af310 0x7f0fcc13a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:52.375 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fcb7fe640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0fcc13d190 0x7f0fcc1d6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:52.375 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fcb7fe640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0fcc13d190 0x7f0fcc1d6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:60902/0 (socket says 172.21.15.130:60902) 2024-06-11T17:33:52.376 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fcb7fe640 1 -- 172.21.15.130:0/3471291686 learned_addr learned my addr 172.21.15.130:0/3471291686 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:33:52.376 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fca7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fcc0af310 0x7f0fcc13a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:60812/0 (socket says 172.21.15.130:60812) 2024-06-11T17:33:52.376 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fcaffd640 1 --2- 172.21.15.130:0/3471291686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0fcc0ae6a0 0x7f0fcc142820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:52.376 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fca7fc640 1 -- 172.21.15.130:0/3471291686 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0fcc13d190 msgr2=0x7f0fcc1d6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:52.376 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fca7fc640 1 --2- 172.21.15.130:0/3471291686 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0fcc13d190 0x7f0fcc1d6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:52.376 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fca7fc640 1 -- 172.21.15.130:0/3471291686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0fcc0ae6a0 msgr2=0x7f0fcc142820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:52.376 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fca7fc640 1 --2- 172.21.15.130:0/3471291686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0fcc0ae6a0 0x7f0fcc142820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:52.376 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fca7fc640 1 -- 172.21.15.130:0/3471291686 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fcc139b90 con 0x7f0fcc0af310 2024-06-11T17:33:52.376 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fcb7fe640 1 --2- 172.21.15.130:0/3471291686 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0fcc13d190 0x7f0fcc1d6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-11T17:33:52.377 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fcaffd640 1 --2- 172.21.15.130:0/3471291686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0fcc0ae6a0 0x7f0fcc142820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-11T17:33:52.377 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fca7fc640 1 --2- 172.21.15.130:0/3471291686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fcc0af310 0x7f0fcc13a730 secure :-1 s=READY pgs=4078 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc007fd0 tx=0x7f0fbc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:52.377 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fb3fff640 1 -- 172.21.15.130:0/3471291686 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc0074e0 con 0x7f0fcc0af310 2024-06-11T17:33:52.377 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fb3fff640 1 -- 172.21.15.130:0/3471291686 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fbc0047f0 con 0x7f0fcc0af310 2024-06-11T17:33:52.377 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fd1a5a640 1 -- 172.21.15.130:0/3471291686 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fcc139e20 con 0x7f0fcc0af310 2024-06-11T17:33:52.377 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fb3fff640 1 -- 172.21.15.130:0/3471291686 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc007680 con 0x7f0fcc0af310 2024-06-11T17:33:52.377 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fd1a5a640 1 -- 172.21.15.130:0/3471291686 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fcc1d75b0 con 0x7f0fcc0af310 2024-06-11T17:33:52.377 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.372+0000 7f0fd1a5a640 1 -- 172.21.15.130:0/3471291686 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fcc0b4fe0 con 0x7f0fcc0af310 2024-06-11T17:33:52.378 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.376+0000 7f0fb3fff640 1 -- 172.21.15.130:0/3471291686 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7f0fbc011070 con 0x7f0fcc0af310 2024-06-11T17:33:52.378 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.376+0000 7f0fb3fff640 1 --2- 172.21.15.130:0/3471291686 >> v2:172.21.15.130:6816/3863300924 conn(0x7f0fb8070d60 0x7f0fb8073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:52.378 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.376+0000 7f0fb3fff640 1 -- 172.21.15.130:0/3471291686 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(702..702 src has 479..702) ==== 5253+0+0 (secure 0 0 0) 0x7f0fbc090970 con 0x7f0fcc0af310 2024-06-11T17:33:52.379 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.376+0000 7f0fcaffd640 1 --2- 172.21.15.130:0/3471291686 >> v2:172.21.15.130:6816/3863300924 conn(0x7f0fb8070d60 0x7f0fb8073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:52.379 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.376+0000 7f0fcaffd640 1 --2- 172.21.15.130:0/3471291686 >> v2:172.21.15.130:6816/3863300924 conn(0x7f0fb8070d60 0x7f0fb8073220 secure :-1 s=READY pgs=3456 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0008930 tx=0x7f0fc0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:52.380 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.380+0000 7f0fb3fff640 1 -- 172.21.15.130:0/3471291686 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7f0fbc05cec0 con 0x7f0fcc0af310 2024-06-11T17:33:52.542 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.540+0000 7f0fd1a5a640 1 -- 172.21.15.130:0/3471291686 --> v2:172.21.15.130:6816/3863300924 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0fcc13f800 con 0x7f0fb8070d60 2024-06-11T17:33:52.544 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.544+0000 7f0fb3fff640 1 -- 172.21.15.130:0/3471291686 <== mgr.4107 v2:172.21.15.130:6816/3863300924 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+116055 (secure 0 0 0) 0x7f0fcc13f800 con 0x7f0fb8070d60 2024-06-11T17:33:52.546 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-11T17:33:52.546 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2024-06-11T17:33:52.547 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.548+0000 7f0fd1a5a640 1 -- 172.21.15.130:0/3471291686 >> v2:172.21.15.130:6816/3863300924 conn(0x7f0fb8070d60 msgr2=0x7f0fb8073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:52.547 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.548+0000 7f0fd1a5a640 1 --2- 172.21.15.130:0/3471291686 >> v2:172.21.15.130:6816/3863300924 conn(0x7f0fb8070d60 0x7f0fb8073220 secure :-1 s=READY pgs=3456 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0008930 tx=0x7f0fc0008040 comp rx=0 tx=0).stop 2024-06-11T17:33:52.547 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.548+0000 7f0fd1a5a640 1 -- 172.21.15.130:0/3471291686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fcc0af310 msgr2=0x7f0fcc13a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:52.548 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.548+0000 7f0fd1a5a640 1 --2- 172.21.15.130:0/3471291686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fcc0af310 0x7f0fcc13a730 secure :-1 s=READY pgs=4078 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc007fd0 tx=0x7f0fbc00c890 comp rx=0 tx=0).stop 2024-06-11T17:33:52.548 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.548+0000 7f0fd1a5a640 1 -- 172.21.15.130:0/3471291686 shutdown_connections 2024-06-11T17:33:52.548 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.548+0000 7f0fd1a5a640 1 --2- 172.21.15.130:0/3471291686 >> v2:172.21.15.130:6816/3863300924 conn(0x7f0fb8070d60 0x7f0fb8073220 unknown :-1 s=CLOSED pgs=3456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:52.548 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.548+0000 7f0fd1a5a640 1 --2- 172.21.15.130:0/3471291686 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0fcc13d190 0x7f0fcc1d6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:52.548 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.548+0000 7f0fd1a5a640 1 --2- 172.21.15.130:0/3471291686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fcc0af310 0x7f0fcc13a730 unknown :-1 s=CLOSED pgs=4078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:52.548 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.548+0000 7f0fd1a5a640 1 --2- 172.21.15.130:0/3471291686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0fcc0ae6a0 0x7f0fcc142820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:52.548 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.548+0000 7f0fd1a5a640 1 -- 172.21.15.130:0/3471291686 >> 172.21.15.130:0/3471291686 conn(0x7f0fcc0b46b0 msgr2=0x7f0fcc0b0240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:52.548 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.548+0000 7f0fd1a5a640 1 -- 172.21.15.130:0/3471291686 shutdown_connections 2024-06-11T17:33:52.549 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.548+0000 7f0fd1a5a640 1 -- 172.21.15.130:0/3471291686 wait complete. 2024-06-11T17:33:52.564 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":1162,"stamp":"2024-06-11T17:33:51.170073+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590373,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":61,"num_write":108,"num_write_kb":1635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":604472,"kb_used_data":71864,"kb_used_omap":12,"kb_used_meta":532531,"kb_avail":754370248,"statfs":{"total":773094113280,"available":772475133952,"internally_reserved":0,"allocated":73588736,"data_stored":38129138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":545312306},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003983"},"pg_stats":[{"pgid":"8.18","version":"0'0","reported_seq":1366,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:32.996973+0000","last_change":"2024-06-11T17:33:32.996973+0000","last_active":"2024-06-11T17:33:32.996973+0000","last_peered":"2024-06-11T17:33:32.996973+0000","last_clean":"2024-06-11T17:33:32.996973+0000","last_became_active":"2024-06-11T17:19:20.245039+0000","last_became_peered":"2024-06-11T17:19:20.245039+0000","last_unstale":"2024-06-11T17:33:32.996973+0000","last_undegraded":"2024-06-11T17:33:32.996973+0000","last_fullsized":"2024-06-11T17:33:32.996973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:32.996733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:32.996733+0000","last_clean_scrub_stamp":"2024-06-11T17:33:32.996733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:40:34.585736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1364,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:34.527443+0000","last_change":"2024-06-11T17:33:34.527443+0000","last_active":"2024-06-11T17:33:34.527443+0000","last_peered":"2024-06-11T17:33:34.527443+0000","last_clean":"2024-06-11T17:33:34.527443+0000","last_became_active":"2024-06-11T17:19:20.143262+0000","last_became_peered":"2024-06-11T17:19:20.143262+0000","last_unstale":"2024-06-11T17:33:34.527443+0000","last_undegraded":"2024-06-11T17:33:34.527443+0000","last_fullsized":"2024-06-11T17:33:34.527443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:34.527216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:34.527216+0000","last_clean_scrub_stamp":"2024-06-11T17:33:34.527216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:33:39.741921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1359,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:31.812141+0000","last_change":"2024-06-11T17:33:31.812178+0000","last_active":"2024-06-11T17:33:31.812141+0000","last_peered":"2024-06-11T17:33:31.812141+0000","last_clean":"2024-06-11T17:33:31.812141+0000","last_became_active":"2024-06-11T17:19:20.165147+0000","last_became_peered":"2024-06-11T17:19:20.165147+0000","last_unstale":"2024-06-11T17:33:31.812141+0000","last_undegraded":"2024-06-11T17:33:31.812141+0000","last_fullsized":"2024-06-11T17:33:31.812141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:31.812036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:31.812036+0000","last_clean_scrub_stamp":"2024-06-11T17:33:31.812036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:28:18.538578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1365,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:31.011370+0000","last_change":"2024-06-11T17:33:31.011426+0000","last_active":"2024-06-11T17:33:31.011370+0000","last_peered":"2024-06-11T17:33:31.011370+0000","last_clean":"2024-06-11T17:33:31.011370+0000","last_became_active":"2024-06-11T17:19:20.204104+0000","last_became_peered":"2024-06-11T17:19:20.204104+0000","last_unstale":"2024-06-11T17:33:31.011370+0000","last_undegraded":"2024-06-11T17:33:31.011370+0000","last_fullsized":"2024-06-11T17:33:31.011370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:31.011203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:31.011203+0000","last_clean_scrub_stamp":"2024-06-11T17:33:31.011203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:23:14.139059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1363,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:33.571765+0000","last_change":"2024-06-11T17:33:33.571817+0000","last_active":"2024-06-11T17:33:33.571765+0000","last_peered":"2024-06-11T17:33:33.571765+0000","last_clean":"2024-06-11T17:33:33.571765+0000","last_became_active":"2024-06-11T17:19:20.141398+0000","last_became_peered":"2024-06-11T17:19:20.141398+0000","last_unstale":"2024-06-11T17:33:33.571765+0000","last_undegraded":"2024-06-11T17:33:33.571765+0000","last_fullsized":"2024-06-11T17:33:33.571765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:33.571587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:33.571587+0000","last_clean_scrub_stamp":"2024-06-11T17:33:33.571587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:29:19.228311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1358,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:33.864206+0000","last_change":"2024-06-11T17:33:33.864265+0000","last_active":"2024-06-11T17:33:33.864206+0000","last_peered":"2024-06-11T17:33:33.864206+0000","last_clean":"2024-06-11T17:33:33.864206+0000","last_became_active":"2024-06-11T17:19:20.192892+0000","last_became_peered":"2024-06-11T17:19:20.192892+0000","last_unstale":"2024-06-11T17:33:33.864206+0000","last_undegraded":"2024-06-11T17:33:33.864206+0000","last_fullsized":"2024-06-11T17:33:33.864206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:33.864010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:33.864010+0000","last_clean_scrub_stamp":"2024-06-11T17:33:33.864010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T04:40:33.497573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1360,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:32.826320+0000","last_change":"2024-06-11T17:33:32.826376+0000","last_active":"2024-06-11T17:33:32.826320+0000","last_peered":"2024-06-11T17:33:32.826320+0000","last_clean":"2024-06-11T17:33:32.826320+0000","last_became_active":"2024-06-11T17:19:20.175221+0000","last_became_peered":"2024-06-11T17:19:20.175221+0000","last_unstale":"2024-06-11T17:33:32.826320+0000","last_undegraded":"2024-06-11T17:33:32.826320+0000","last_fullsized":"2024-06-11T17:33:32.826320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:32.826134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:32.826134+0000","last_clean_scrub_stamp":"2024-06-11T17:33:32.826134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T04:11:23.498112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1356,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:32.946497+0000","last_change":"2024-06-11T17:33:32.946551+0000","last_active":"2024-06-11T17:33:32.946497+0000","last_peered":"2024-06-11T17:33:32.946497+0000","last_clean":"2024-06-11T17:33:32.946497+0000","last_became_active":"2024-06-11T17:19:20.120302+0000","last_became_peered":"2024-06-11T17:19:20.120302+0000","last_unstale":"2024-06-11T17:33:32.946497+0000","last_undegraded":"2024-06-11T17:33:32.946497+0000","last_fullsized":"2024-06-11T17:33:32.946497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:32.946321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:32.946321+0000","last_clean_scrub_stamp":"2024-06-11T17:33:32.946321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T05:15:01.647359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1387,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:35.180015+0000","last_change":"2024-06-11T17:33:35.180142+0000","last_active":"2024-06-11T17:33:35.180015+0000","last_peered":"2024-06-11T17:33:35.180015+0000","last_clean":"2024-06-11T17:33:35.180015+0000","last_became_active":"2024-06-11T17:19:20.243122+0000","last_became_peered":"2024-06-11T17:19:20.243122+0000","last_unstale":"2024-06-11T17:33:35.180015+0000","last_undegraded":"2024-06-11T17:33:35.180015+0000","last_fullsized":"2024-06-11T17:33:35.180015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:35.179784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:35.179784+0000","last_clean_scrub_stamp":"2024-06-11T17:33:35.179784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:13:32.458814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1","version":"702'8","reported_seq":1370,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:33.947211+0000","last_change":"2024-06-11T17:33:33.947272+0000","last_active":"2024-06-11T17:33:33.947211+0000","last_peered":"2024-06-11T17:33:33.947211+0000","last_clean":"2024-06-11T17:33:33.947211+0000","last_became_active":"2024-06-11T17:19:20.191981+0000","last_became_peered":"2024-06-11T17:19:20.191981+0000","last_unstale":"2024-06-11T17:33:33.947211+0000","last_undegraded":"2024-06-11T17:33:33.947211+0000","last_fullsized":"2024-06-11T17:33:33.947211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"702'8","last_scrub_stamp":"2024-06-11T17:33:33.947041+0000","last_deep_scrub":"702'8","last_deep_scrub_stamp":"2024-06-11T17:33:33.947041+0000","last_clean_scrub_stamp":"2024-06-11T17:33:33.947041+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:05:29.592906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1366,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:33.947127+0000","last_change":"2024-06-11T17:33:33.947178+0000","last_active":"2024-06-11T17:33:33.947127+0000","last_peered":"2024-06-11T17:33:33.947127+0000","last_clean":"2024-06-11T17:33:33.947127+0000","last_became_active":"2024-06-11T17:19:20.247875+0000","last_became_peered":"2024-06-11T17:19:20.247875+0000","last_unstale":"2024-06-11T17:33:33.947127+0000","last_undegraded":"2024-06-11T17:33:33.947127+0000","last_fullsized":"2024-06-11T17:33:33.947127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:33.946963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:33.946963+0000","last_clean_scrub_stamp":"2024-06-11T17:33:33.946963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:22:31.283090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1356,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:34.903553+0000","last_change":"2024-06-11T17:33:34.903608+0000","last_active":"2024-06-11T17:33:34.903553+0000","last_peered":"2024-06-11T17:33:34.903553+0000","last_clean":"2024-06-11T17:33:34.903553+0000","last_became_active":"2024-06-11T17:19:20.250080+0000","last_became_peered":"2024-06-11T17:19:20.250080+0000","last_unstale":"2024-06-11T17:33:34.903553+0000","last_undegraded":"2024-06-11T17:33:34.903553+0000","last_fullsized":"2024-06-11T17:33:34.903553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:34.903370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:34.903370+0000","last_clean_scrub_stamp":"2024-06-11T17:33:34.903370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:13:43.319879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"702'74","reported_seq":1450,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:34.071742+0000","last_change":"2024-06-11T17:33:34.071810+0000","last_active":"2024-06-11T17:33:34.071742+0000","last_peered":"2024-06-11T17:33:34.071742+0000","last_clean":"2024-06-11T17:33:34.071742+0000","last_became_active":"2024-06-11T17:18:20.657407+0000","last_became_peered":"2024-06-11T17:18:20.657407+0000","last_unstale":"2024-06-11T17:33:34.071742+0000","last_undegraded":"2024-06-11T17:33:34.071742+0000","last_fullsized":"2024-06-11T17:33:34.071742+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"702'74","last_scrub_stamp":"2024-06-11T17:33:34.071575+0000","last_deep_scrub":"702'74","last_deep_scrub_stamp":"2024-06-11T17:33:34.071575+0000","last_clean_scrub_stamp":"2024-06-11T17:33:34.071575+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:32:10.566710+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1371,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:31.561870+0000","last_change":"2024-06-11T17:33:31.561925+0000","last_active":"2024-06-11T17:33:31.561870+0000","last_peered":"2024-06-11T17:33:31.561870+0000","last_clean":"2024-06-11T17:33:31.561870+0000","last_became_active":"2024-06-11T17:18:20.575356+0000","last_became_peered":"2024-06-11T17:18:20.575356+0000","last_unstale":"2024-06-11T17:33:31.561870+0000","last_undegraded":"2024-06-11T17:33:31.561870+0000","last_fullsized":"2024-06-11T17:33:31.561870+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:31.561684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:31.561684+0000","last_clean_scrub_stamp":"2024-06-11T17:33:31.561684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:29:28.699622+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1358,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:34.875596+0000","last_change":"2024-06-11T17:33:34.875651+0000","last_active":"2024-06-11T17:33:34.875596+0000","last_peered":"2024-06-11T17:33:34.875596+0000","last_clean":"2024-06-11T17:33:34.875596+0000","last_became_active":"2024-06-11T17:19:20.238515+0000","last_became_peered":"2024-06-11T17:19:20.238515+0000","last_unstale":"2024-06-11T17:33:34.875596+0000","last_undegraded":"2024-06-11T17:33:34.875596+0000","last_fullsized":"2024-06-11T17:33:34.875596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:34.875415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:34.875415+0000","last_clean_scrub_stamp":"2024-06-11T17:33:34.875415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:49:26.231459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1358,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:32.020170+0000","last_change":"2024-06-11T17:33:32.020220+0000","last_active":"2024-06-11T17:33:32.020170+0000","last_peered":"2024-06-11T17:33:32.020170+0000","last_clean":"2024-06-11T17:33:32.020170+0000","last_became_active":"2024-06-11T17:18:20.575851+0000","last_became_peered":"2024-06-11T17:18:20.575851+0000","last_unstale":"2024-06-11T17:33:32.020170+0000","last_undegraded":"2024-06-11T17:33:32.020170+0000","last_fullsized":"2024-06-11T17:33:32.020170+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:32.020013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:32.020013+0000","last_clean_scrub_stamp":"2024-06-11T17:33:32.020013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:19:16.657444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1356,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:31.903960+0000","last_change":"2024-06-11T17:33:31.904009+0000","last_active":"2024-06-11T17:33:31.903960+0000","last_peered":"2024-06-11T17:33:31.903960+0000","last_clean":"2024-06-11T17:33:31.903960+0000","last_became_active":"2024-06-11T17:19:20.106199+0000","last_became_peered":"2024-06-11T17:19:20.106199+0000","last_unstale":"2024-06-11T17:33:31.903960+0000","last_undegraded":"2024-06-11T17:33:31.903960+0000","last_fullsized":"2024-06-11T17:33:31.903960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:31.903844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:31.903844+0000","last_clean_scrub_stamp":"2024-06-11T17:33:31.903844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T04:35:46.261505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1377,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:29.988232+0000","last_change":"2024-06-11T17:33:29.988331+0000","last_active":"2024-06-11T17:33:29.988232+0000","last_peered":"2024-06-11T17:33:29.988232+0000","last_clean":"2024-06-11T17:33:29.988232+0000","last_became_active":"2024-06-11T17:18:20.571627+0000","last_became_peered":"2024-06-11T17:18:20.571627+0000","last_unstale":"2024-06-11T17:33:29.988232+0000","last_undegraded":"2024-06-11T17:33:29.988232+0000","last_fullsized":"2024-06-11T17:33:29.988232+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:29.988026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:29.988026+0000","last_clean_scrub_stamp":"2024-06-11T17:33:29.988026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:27:25.240418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1386,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:33.213060+0000","last_change":"2024-06-11T17:33:33.213116+0000","last_active":"2024-06-11T17:33:33.213060+0000","last_peered":"2024-06-11T17:33:33.213060+0000","last_clean":"2024-06-11T17:33:33.213060+0000","last_became_active":"2024-06-11T17:19:20.205013+0000","last_became_peered":"2024-06-11T17:19:20.205013+0000","last_unstale":"2024-06-11T17:33:33.213060+0000","last_undegraded":"2024-06-11T17:33:33.213060+0000","last_fullsized":"2024-06-11T17:33:33.213060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:33.212851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:33.212851+0000","last_clean_scrub_stamp":"2024-06-11T17:33:33.212851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:08:31.032756+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1371,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:32.570225+0000","last_change":"2024-06-11T17:33:32.570279+0000","last_active":"2024-06-11T17:33:32.570225+0000","last_peered":"2024-06-11T17:33:32.570225+0000","last_clean":"2024-06-11T17:33:32.570225+0000","last_became_active":"2024-06-11T17:18:20.575917+0000","last_became_peered":"2024-06-11T17:18:20.575917+0000","last_unstale":"2024-06-11T17:33:32.570225+0000","last_undegraded":"2024-06-11T17:33:32.570225+0000","last_fullsized":"2024-06-11T17:33:32.570225+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:32.570035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:32.570035+0000","last_clean_scrub_stamp":"2024-06-11T17:33:32.570035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:28:51.074819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1364,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:38.508413+0000","last_change":"2024-06-11T17:33:38.508466+0000","last_active":"2024-06-11T17:33:38.508413+0000","last_peered":"2024-06-11T17:33:38.508413+0000","last_clean":"2024-06-11T17:33:38.508413+0000","last_became_active":"2024-06-11T17:19:20.256125+0000","last_became_peered":"2024-06-11T17:19:20.256125+0000","last_unstale":"2024-06-11T17:33:38.508413+0000","last_undegraded":"2024-06-11T17:33:38.508413+0000","last_fullsized":"2024-06-11T17:33:38.508413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:38.508235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:38.508235+0000","last_clean_scrub_stamp":"2024-06-11T17:33:38.508235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:43:41.621220+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1363,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:30.928048+0000","last_change":"2024-06-11T17:33:30.928083+0000","last_active":"2024-06-11T17:33:30.928048+0000","last_peered":"2024-06-11T17:33:30.928048+0000","last_clean":"2024-06-11T17:33:30.928048+0000","last_became_active":"2024-06-11T17:18:20.656011+0000","last_became_peered":"2024-06-11T17:18:20.656011+0000","last_unstale":"2024-06-11T17:33:30.928048+0000","last_undegraded":"2024-06-11T17:33:30.928048+0000","last_fullsized":"2024-06-11T17:33:30.928048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:30.927942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:30.927942+0000","last_clean_scrub_stamp":"2024-06-11T17:33:30.927942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:28:23.523854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1360,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:29.817919+0000","last_change":"2024-06-11T17:33:29.817961+0000","last_active":"2024-06-11T17:33:29.817919+0000","last_peered":"2024-06-11T17:33:29.817919+0000","last_clean":"2024-06-11T17:33:29.817919+0000","last_became_active":"2024-06-11T17:19:20.129276+0000","last_became_peered":"2024-06-11T17:19:20.129276+0000","last_unstale":"2024-06-11T17:33:29.817919+0000","last_undegraded":"2024-06-11T17:33:29.817919+0000","last_fullsized":"2024-06-11T17:33:29.817919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:29.817810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:29.817810+0000","last_clean_scrub_stamp":"2024-06-11T17:33:29.817810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:49:22.452394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1358,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:33.054536+0000","last_change":"2024-06-11T17:33:33.054594+0000","last_active":"2024-06-11T17:33:33.054536+0000","last_peered":"2024-06-11T17:33:33.054536+0000","last_clean":"2024-06-11T17:33:33.054536+0000","last_became_active":"2024-06-11T17:18:20.658322+0000","last_became_peered":"2024-06-11T17:18:20.658322+0000","last_unstale":"2024-06-11T17:33:33.054536+0000","last_undegraded":"2024-06-11T17:33:33.054536+0000","last_fullsized":"2024-06-11T17:33:33.054536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:33.054355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:33.054355+0000","last_clean_scrub_stamp":"2024-06-11T17:33:33.054355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:40:30.055941+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1386,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:34.226642+0000","last_change":"2024-06-11T17:33:34.226742+0000","last_active":"2024-06-11T17:33:34.226642+0000","last_peered":"2024-06-11T17:33:34.226642+0000","last_clean":"2024-06-11T17:33:34.226642+0000","last_became_active":"2024-06-11T17:19:20.206654+0000","last_became_peered":"2024-06-11T17:19:20.206654+0000","last_unstale":"2024-06-11T17:33:34.226642+0000","last_undegraded":"2024-06-11T17:33:34.226642+0000","last_fullsized":"2024-06-11T17:33:34.226642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:34.226421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:34.226421+0000","last_clean_scrub_stamp":"2024-06-11T17:33:34.226421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:02:58.439863+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1363,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:29.967680+0000","last_change":"2024-06-11T17:33:29.967731+0000","last_active":"2024-06-11T17:33:29.967680+0000","last_peered":"2024-06-11T17:33:29.967680+0000","last_clean":"2024-06-11T17:33:29.967680+0000","last_became_active":"2024-06-11T17:18:20.573196+0000","last_became_peered":"2024-06-11T17:18:20.573196+0000","last_unstale":"2024-06-11T17:33:29.967680+0000","last_undegraded":"2024-06-11T17:33:29.967680+0000","last_fullsized":"2024-06-11T17:33:29.967680+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:29.967515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:29.967515+0000","last_clean_scrub_stamp":"2024-06-11T17:33:29.967515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:42:33.905860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1360,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:28.785310+0000","last_change":"2024-06-11T17:33:28.785335+0000","last_active":"2024-06-11T17:33:28.785310+0000","last_peered":"2024-06-11T17:33:28.785310+0000","last_clean":"2024-06-11T17:33:28.785310+0000","last_became_active":"2024-06-11T17:19:20.099516+0000","last_became_peered":"2024-06-11T17:19:20.099516+0000","last_unstale":"2024-06-11T17:33:28.785310+0000","last_undegraded":"2024-06-11T17:33:28.785310+0000","last_fullsized":"2024-06-11T17:33:28.785310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:28.785221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:28.785221+0000","last_clean_scrub_stamp":"2024-06-11T17:33:28.785221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:59:12.301900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1365,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:31.876772+0000","last_change":"2024-06-11T17:33:31.876772+0000","last_active":"2024-06-11T17:33:31.876772+0000","last_peered":"2024-06-11T17:33:31.876772+0000","last_clean":"2024-06-11T17:33:31.876772+0000","last_became_active":"2024-06-11T17:18:20.574485+0000","last_became_peered":"2024-06-11T17:18:20.574485+0000","last_unstale":"2024-06-11T17:33:31.876772+0000","last_undegraded":"2024-06-11T17:33:31.876772+0000","last_fullsized":"2024-06-11T17:33:31.876772+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:31.876550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:31.876550+0000","last_clean_scrub_stamp":"2024-06-11T17:33:31.876550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T05:33:18.706012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1364,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:37.492526+0000","last_change":"2024-06-11T17:33:37.492584+0000","last_active":"2024-06-11T17:33:37.492526+0000","last_peered":"2024-06-11T17:33:37.492526+0000","last_clean":"2024-06-11T17:33:37.492526+0000","last_became_active":"2024-06-11T17:19:20.216412+0000","last_became_peered":"2024-06-11T17:19:20.216412+0000","last_unstale":"2024-06-11T17:33:37.492526+0000","last_undegraded":"2024-06-11T17:33:37.492526+0000","last_fullsized":"2024-06-11T17:33:37.492526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:37.492335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:37.492335+0000","last_clean_scrub_stamp":"2024-06-11T17:33:37.492335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:13:12.832485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1360,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:30.837821+0000","last_change":"2024-06-11T17:33:30.837857+0000","last_active":"2024-06-11T17:33:30.837821+0000","last_peered":"2024-06-11T17:33:30.837821+0000","last_clean":"2024-06-11T17:33:30.837821+0000","last_became_active":"2024-06-11T17:19:20.148798+0000","last_became_peered":"2024-06-11T17:19:20.148798+0000","last_unstale":"2024-06-11T17:33:30.837821+0000","last_undegraded":"2024-06-11T17:33:30.837821+0000","last_fullsized":"2024-06-11T17:33:30.837821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:30.837732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:30.837732+0000","last_clean_scrub_stamp":"2024-06-11T17:33:30.837732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:27:02.932865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1387,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:32.190531+0000","last_change":"2024-06-11T17:33:32.190567+0000","last_active":"2024-06-11T17:33:32.190531+0000","last_peered":"2024-06-11T17:33:32.190531+0000","last_clean":"2024-06-11T17:33:32.190531+0000","last_became_active":"2024-06-11T17:19:20.125396+0000","last_became_peered":"2024-06-11T17:19:20.125396+0000","last_unstale":"2024-06-11T17:33:32.190531+0000","last_undegraded":"2024-06-11T17:33:32.190531+0000","last_fullsized":"2024-06-11T17:33:32.190531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:32.190427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:32.190427+0000","last_clean_scrub_stamp":"2024-06-11T17:33:32.190427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:54:51.135627+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1359,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:33.823782+0000","last_change":"2024-06-11T17:33:33.823878+0000","last_active":"2024-06-11T17:33:33.823782+0000","last_peered":"2024-06-11T17:33:33.823782+0000","last_clean":"2024-06-11T17:33:33.823782+0000","last_became_active":"2024-06-11T17:19:20.226102+0000","last_became_peered":"2024-06-11T17:19:20.226102+0000","last_unstale":"2024-06-11T17:33:33.823782+0000","last_undegraded":"2024-06-11T17:33:33.823782+0000","last_fullsized":"2024-06-11T17:33:33.823782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:33.823505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:33.823505+0000","last_clean_scrub_stamp":"2024-06-11T17:33:33.823505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:28:46.874627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1363,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:35.530457+0000","last_change":"2024-06-11T17:33:35.530513+0000","last_active":"2024-06-11T17:33:35.530457+0000","last_peered":"2024-06-11T17:33:35.530457+0000","last_clean":"2024-06-11T17:33:35.530457+0000","last_became_active":"2024-06-11T17:19:20.211650+0000","last_became_peered":"2024-06-11T17:19:20.211650+0000","last_unstale":"2024-06-11T17:33:35.530457+0000","last_undegraded":"2024-06-11T17:33:35.530457+0000","last_fullsized":"2024-06-11T17:33:35.530457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:35.530280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:35.530280+0000","last_clean_scrub_stamp":"2024-06-11T17:33:35.530280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:35:12.047215+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1386,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:30.226941+0000","last_change":"2024-06-11T17:33:30.226961+0000","last_active":"2024-06-11T17:33:30.226941+0000","last_peered":"2024-06-11T17:33:30.226941+0000","last_clean":"2024-06-11T17:33:30.226941+0000","last_became_active":"2024-06-11T17:19:20.092900+0000","last_became_peered":"2024-06-11T17:19:20.092900+0000","last_unstale":"2024-06-11T17:33:30.226941+0000","last_undegraded":"2024-06-11T17:33:30.226941+0000","last_fullsized":"2024-06-11T17:33:30.226941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:30.226863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:30.226863+0000","last_clean_scrub_stamp":"2024-06-11T17:33:30.226863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:48:15.395344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1358,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:32.858638+0000","last_change":"2024-06-11T17:33:32.858694+0000","last_active":"2024-06-11T17:33:32.858638+0000","last_peered":"2024-06-11T17:33:32.858638+0000","last_clean":"2024-06-11T17:33:32.858638+0000","last_became_active":"2024-06-11T17:19:20.164153+0000","last_became_peered":"2024-06-11T17:19:20.164153+0000","last_unstale":"2024-06-11T17:33:32.858638+0000","last_undegraded":"2024-06-11T17:33:32.858638+0000","last_fullsized":"2024-06-11T17:33:32.858638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:32.858449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:32.858449+0000","last_clean_scrub_stamp":"2024-06-11T17:33:32.858449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T05:28:39.221941+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1364,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:36.520179+0000","last_change":"2024-06-11T17:33:36.520233+0000","last_active":"2024-06-11T17:33:36.520179+0000","last_peered":"2024-06-11T17:33:36.520179+0000","last_clean":"2024-06-11T17:33:36.520179+0000","last_became_active":"2024-06-11T17:19:20.211450+0000","last_became_peered":"2024-06-11T17:19:20.211450+0000","last_unstale":"2024-06-11T17:33:36.520179+0000","last_undegraded":"2024-06-11T17:33:36.520179+0000","last_fullsized":"2024-06-11T17:33:36.520179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:36.519998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:36.519998+0000","last_clean_scrub_stamp":"2024-06-11T17:33:36.519998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T04:00:56.609759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1351,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:35.018715+0000","last_change":"2024-06-11T17:33:35.018767+0000","last_active":"2024-06-11T17:33:35.018715+0000","last_peered":"2024-06-11T17:33:35.018715+0000","last_clean":"2024-06-11T17:33:35.018715+0000","last_became_active":"2024-06-11T17:19:20.157763+0000","last_became_peered":"2024-06-11T17:19:20.157763+0000","last_unstale":"2024-06-11T17:33:35.018715+0000","last_undegraded":"2024-06-11T17:33:35.018715+0000","last_fullsized":"2024-06-11T17:33:35.018715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:35.018542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:35.018542+0000","last_clean_scrub_stamp":"2024-06-11T17:33:35.018542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T04:48:59.357978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1351,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:36.041231+0000","last_change":"2024-06-11T17:33:36.041231+0000","last_active":"2024-06-11T17:33:36.041231+0000","last_peered":"2024-06-11T17:33:36.041231+0000","last_clean":"2024-06-11T17:33:36.041231+0000","last_became_active":"2024-06-11T17:19:20.180567+0000","last_became_peered":"2024-06-11T17:19:20.180567+0000","last_unstale":"2024-06-11T17:33:36.041231+0000","last_undegraded":"2024-06-11T17:33:36.041231+0000","last_fullsized":"2024-06-11T17:33:36.041231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:36.041001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:36.041001+0000","last_clean_scrub_stamp":"2024-06-11T17:33:36.041001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:56:36.041654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1385,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:31.231603+0000","last_change":"2024-06-11T17:33:31.231629+0000","last_active":"2024-06-11T17:33:31.231603+0000","last_peered":"2024-06-11T17:33:31.231603+0000","last_clean":"2024-06-11T17:33:31.231603+0000","last_became_active":"2024-06-11T17:19:20.092534+0000","last_became_peered":"2024-06-11T17:19:20.092534+0000","last_unstale":"2024-06-11T17:33:31.231603+0000","last_undegraded":"2024-06-11T17:33:31.231603+0000","last_fullsized":"2024-06-11T17:33:31.231603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:31.231510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:31.231510+0000","last_clean_scrub_stamp":"2024-06-11T17:33:31.231510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:46:09.475128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1351,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:37.086438+0000","last_change":"2024-06-11T17:33:37.086438+0000","last_active":"2024-06-11T17:33:37.086438+0000","last_peered":"2024-06-11T17:33:37.086438+0000","last_clean":"2024-06-11T17:33:37.086438+0000","last_became_active":"2024-06-11T17:19:20.212735+0000","last_became_peered":"2024-06-11T17:19:20.212735+0000","last_unstale":"2024-06-11T17:33:37.086438+0000","last_undegraded":"2024-06-11T17:33:37.086438+0000","last_fullsized":"2024-06-11T17:33:37.086438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:37.086227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:37.086227+0000","last_clean_scrub_stamp":"2024-06-11T17:33:37.086227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:09:40.013547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1366,"reported_epoch":702,"state":"active+clean","last_fresh":"2024-06-11T17:33:31.984645+0000","last_change":"2024-06-11T17:33:31.984748+0000","last_active":"2024-06-11T17:33:31.984645+0000","last_peered":"2024-06-11T17:33:31.984645+0000","last_clean":"2024-06-11T17:33:31.984645+0000","last_became_active":"2024-06-11T17:19:20.244248+0000","last_became_peered":"2024-06-11T17:19:20.244248+0000","last_unstale":"2024-06-11T17:33:31.984645+0000","last_undegraded":"2024-06-11T17:33:31.984645+0000","last_fullsized":"2024-06-11T17:33:31.984645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T17:33:31.984451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T17:33:31.984451+0000","last_clean_scrub_stamp":"2024-06-11T17:33:31.984451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:47:44.378121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542333,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72484,"kb_used_data":9372,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94299356,"statfs":{"total":96636764160,"available":96562540544,"internally_reserved":0,"allocated":9596928,"data_stored":5162837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":64616906},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542335,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71964,"kb_used_data":8852,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94299876,"statfs":{"total":96636764160,"available":96563073024,"internally_reserved":0,"allocated":9064448,"data_stored":4633909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542334,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84444,"kb_used_data":8852,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94287396,"statfs":{"total":96636764160,"available":96550293504,"internally_reserved":0,"allocated":9064448,"data_stored":4633909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542335,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71964,"kb_used_data":8852,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94299876,"statfs":{"total":96636764160,"available":96563073024,"internally_reserved":0,"allocated":9064448,"data_stored":4633909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542334,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72488,"kb_used_data":9376,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94299352,"statfs":{"total":96636764160,"available":96562536448,"internally_reserved":0,"allocated":9601024,"data_stored":5162842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575037,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84444,"kb_used_data":8852,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94287396,"statfs":{"total":96636764160,"available":96550293504,"internally_reserved":0,"allocated":9064448,"data_stored":4633909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575037,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62236,"kb_used_data":8852,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94309604,"statfs":{"total":96636764160,"available":96573034496,"internally_reserved":0,"allocated":9064448,"data_stored":4633909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575039,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84448,"kb_used_data":8856,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94287392,"statfs":{"total":96636764160,"available":96550289408,"internally_reserved":0,"allocated":9068544,"data_stored":4633914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-11T17:33:52.568 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-06-11T17:33:52.679 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.680+0000 7fea6046a640 1 Processor -- start 2024-06-11T17:33:52.679 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.680+0000 7fea6046a640 1 -- start start 2024-06-11T17:33:52.680 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.680+0000 7fea6046a640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fea580af310 0x7fea5813f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:52.680 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.680+0000 7fea6046a640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea580aca90 con 0x7fea5813d190 2024-06-11T17:33:52.680 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.680+0000 7fea6046a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea580ad920 con 0x7fea580ae6a0 2024-06-11T17:33:52.681 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.680+0000 7fea6046a640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fea580af6f0 con 0x7fea580af310 2024-06-11T17:33:52.681 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.680+0000 7fea5e206640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fea580af310 0x7fea5813f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:52.681 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.680+0000 7fea5ea07640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fea5813d190 0x7fea5814a0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:38162/0 (socket says 172.21.15.130:38162) 2024-06-11T17:33:52.681 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.680+0000 7fea5ea07640 1 -- 172.21.15.130:0/248759938 learned_addr learned my addr 172.21.15.130:0/248759938 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-06-11T17:33:52.681 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.680+0000 7fea5d204640 1 -- 172.21.15.130:0/248759938 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3385301759 0 0) 0x7fea580aca90 con 0x7fea5813d190 2024-06-11T17:33:52.681 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.680+0000 7fea5d204640 1 -- 172.21.15.130:0/248759938 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea44005740 con 0x7fea5813d190 2024-06-11T17:33:52.681 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.680+0000 7fea5e206640 1 -- 172.21.15.130:0/248759938 >> v1:172.21.15.172:6789/0 conn(0x7fea580ae6a0 legacy=0x7fea5813ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-11T17:33:52.681 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.680+0000 7fea5e206640 1 -- 172.21.15.130:0/248759938 >> v1:172.21.15.130:6789/0 conn(0x7fea5813d190 legacy=0x7fea5814a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:52.682 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.680+0000 7fea5e206640 1 -- 172.21.15.130:0/248759938 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea580adc00 con 0x7fea580af310 2024-06-11T17:33:52.682 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea5e206640 1 --2- 172.21.15.130:0/248759938 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea580af310 0x7fea5813f800 secure :-1 s=READY pgs=4080 cs=0 l=1 rev1=1 crypto rx=0x7fea540097c0 tx=0x7fea5401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=261f9438adfa6c3c server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:52.683 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea5d204640 1 -- 172.21.15.130:0/248759938 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea540b0070 con 0x7fea580af310 2024-06-11T17:33:52.683 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea5d204640 1 -- 172.21.15.130:0/248759938 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea540ab600 con 0x7fea580af310 2024-06-11T17:33:52.683 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea5d204640 1 -- 172.21.15.130:0/248759938 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea540ab9d0 con 0x7fea580af310 2024-06-11T17:33:52.684 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea6046a640 1 -- 172.21.15.130:0/248759938 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea580af310 msgr2=0x7fea5813f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:52.684 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea6046a640 1 --2- 172.21.15.130:0/248759938 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea580af310 0x7fea5813f800 secure :-1 s=READY pgs=4080 cs=0 l=1 rev1=1 crypto rx=0x7fea540097c0 tx=0x7fea5401c3f0 comp rx=0 tx=0).stop 2024-06-11T17:33:52.684 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea6046a640 1 -- 172.21.15.130:0/248759938 shutdown_connections 2024-06-11T17:33:52.684 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea6046a640 1 --2- 172.21.15.130:0/248759938 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea580af310 0x7fea5813f800 unknown :-1 s=CLOSED pgs=4080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:52.684 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea6046a640 1 -- 172.21.15.130:0/248759938 >> 172.21.15.130:0/248759938 conn(0x7fea580b46b0 msgr2=0x7fea580b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:52.684 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea6046a640 1 -- 172.21.15.130:0/248759938 shutdown_connections 2024-06-11T17:33:52.684 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea6046a640 1 -- 172.21.15.130:0/248759938 wait complete. 2024-06-11T17:33:52.686 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea6046a640 1 Processor -- start 2024-06-11T17:33:52.686 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea6046a640 1 -- start start 2024-06-11T17:33:52.687 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea6046a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea580ae6a0 0x7fea58133e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:52.687 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea6046a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea580af310 0x7fea58143800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:52.687 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea6046a640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fea5813d190 0x7fea5813a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:52.687 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea6046a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fea580b0520 con 0x7fea580af310 2024-06-11T17:33:52.687 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea6046a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fea580b03a0 con 0x7fea580ae6a0 2024-06-11T17:33:52.687 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea6046a640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fea580b06a0 con 0x7fea5813d190 2024-06-11T17:33:52.687 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea5da05640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea580af310 0x7fea58143800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:52.687 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea5ea07640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fea5813d190 0x7fea5813a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:52.688 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea5da05640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea580af310 0x7fea58143800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:60838/0 (socket says 172.21.15.130:60838) 2024-06-11T17:33:52.688 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea5da05640 1 -- 172.21.15.130:0/4040593622 learned_addr learned my addr 172.21.15.130:0/4040593622 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-06-11T17:33:52.688 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea5e206640 1 --2- 172.21.15.130:0/4040593622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea580ae6a0 0x7fea58133e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:52.688 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea5da05640 1 -- 172.21.15.130:0/4040593622 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fea5813d190 msgr2=0x7fea5813a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:52.688 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea5da05640 1 --2- 172.21.15.130:0/4040593622 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fea5813d190 0x7fea5813a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:52.688 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea5da05640 1 -- 172.21.15.130:0/4040593622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea580ae6a0 msgr2=0x7fea58133e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:52.688 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea5da05640 1 --2- 172.21.15.130:0/4040593622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea580ae6a0 0x7fea58133e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:52.688 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea5da05640 1 -- 172.21.15.130:0/4040593622 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea58139c80 con 0x7fea580af310 2024-06-11T17:33:52.689 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea5da05640 1 --2- 172.21.15.130:0/4040593622 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea580af310 0x7fea58143800 secure :-1 s=READY pgs=4081 cs=0 l=1 rev1=1 crypto rx=0x7fea4800c500 tx=0x7fea4800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:52.689 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea4effd640 1 -- 172.21.15.130:0/4040593622 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea48017070 con 0x7fea580af310 2024-06-11T17:33:52.689 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea4effd640 1 -- 172.21.15.130:0/4040593622 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea480052d0 con 0x7fea580af310 2024-06-11T17:33:52.689 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea4effd640 1 -- 172.21.15.130:0/4040593622 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea48012870 con 0x7fea580af310 2024-06-11T17:33:52.689 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea6046a640 1 -- 172.21.15.130:0/4040593622 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea5813a1d0 con 0x7fea580af310 2024-06-11T17:33:52.689 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.684+0000 7fea6046a640 1 -- 172.21.15.130:0/4040593622 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea58142780 con 0x7fea580af310 2024-06-11T17:33:52.689 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.688+0000 7fea6046a640 1 -- 172.21.15.130:0/4040593622 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea5813f800 con 0x7fea580af310 2024-06-11T17:33:52.690 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.688+0000 7fea4effd640 1 -- 172.21.15.130:0/4040593622 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 94269+0+0 (secure 0 0 0) 0x7fea4801a070 con 0x7fea580af310 2024-06-11T17:33:52.690 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.688+0000 7fea4effd640 1 --2- 172.21.15.130:0/4040593622 >> v2:172.21.15.130:6816/3863300924 conn(0x7fea3c070d60 0x7fea3c073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-11T17:33:52.690 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.688+0000 7fea5e206640 1 --2- 172.21.15.130:0/4040593622 >> v2:172.21.15.130:6816/3863300924 conn(0x7fea3c070d60 0x7fea3c073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-11T17:33:52.691 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.688+0000 7fea4effd640 1 -- 172.21.15.130:0/4040593622 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(702..702 src has 479..702) ==== 5253+0+0 (secure 0 0 0) 0x7fea48090120 con 0x7fea580af310 2024-06-11T17:33:52.691 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.688+0000 7fea5e206640 1 --2- 172.21.15.130:0/4040593622 >> v2:172.21.15.130:6816/3863300924 conn(0x7fea3c070d60 0x7fea3c073220 secure :-1 s=READY pgs=3457 cs=0 l=1 rev1=1 crypto rx=0x7fea540ad000 tx=0x7fea54008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-11T17:33:52.692 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.692+0000 7fea4effd640 1 -- 172.21.15.130:0/4040593622 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+182766 (secure 0 0 0) 0x7fea48005480 con 0x7fea580af310 2024-06-11T17:33:52.858 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.860+0000 7fea6046a640 1 -- 172.21.15.130:0/4040593622 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fea58139ef0 con 0x7fea580af310 2024-06-11T17:33:52.863 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.864+0000 7fea4effd640 1 -- 172.21.15.130:0/4040593622 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v7)=0 v7) ==== 123+0+0 (secure 0 0 0) 0x7fea4805bfa0 con 0x7fea580af310 2024-06-11T17:33:52.865 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.864+0000 7fea4effd640 1 -- 172.21.15.130:0/4040593622 <== mon.0 v2:172.21.15.130:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fea4805bab0 con 0x7fea580af310 2024-06-11T17:33:52.867 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.868+0000 7fea6046a640 1 -- 172.21.15.130:0/4040593622 >> v2:172.21.15.130:6816/3863300924 conn(0x7fea3c070d60 msgr2=0x7fea3c073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:52.867 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.868+0000 7fea6046a640 1 --2- 172.21.15.130:0/4040593622 >> v2:172.21.15.130:6816/3863300924 conn(0x7fea3c070d60 0x7fea3c073220 secure :-1 s=READY pgs=3457 cs=0 l=1 rev1=1 crypto rx=0x7fea540ad000 tx=0x7fea54008040 comp rx=0 tx=0).stop 2024-06-11T17:33:52.867 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.868+0000 7fea6046a640 1 -- 172.21.15.130:0/4040593622 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea580af310 msgr2=0x7fea58143800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-11T17:33:52.867 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.868+0000 7fea6046a640 1 --2- 172.21.15.130:0/4040593622 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea580af310 0x7fea58143800 secure :-1 s=READY pgs=4081 cs=0 l=1 rev1=1 crypto rx=0x7fea4800c500 tx=0x7fea4800c9c0 comp rx=0 tx=0).stop 2024-06-11T17:33:52.868 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.868+0000 7fea6046a640 1 -- 172.21.15.130:0/4040593622 shutdown_connections 2024-06-11T17:33:52.868 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.868+0000 7fea6046a640 1 --2- 172.21.15.130:0/4040593622 >> v2:172.21.15.130:6816/3863300924 conn(0x7fea3c070d60 0x7fea3c073220 unknown :-1 s=CLOSED pgs=3457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:52.868 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.868+0000 7fea6046a640 1 --2- 172.21.15.130:0/4040593622 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fea5813d190 0x7fea5813a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:52.868 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.868+0000 7fea6046a640 1 --2- 172.21.15.130:0/4040593622 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea580af310 0x7fea58143800 unknown :-1 s=CLOSED pgs=4081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:52.868 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.868+0000 7fea6046a640 1 --2- 172.21.15.130:0/4040593622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea580ae6a0 0x7fea58133e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-11T17:33:52.868 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.868+0000 7fea6046a640 1 -- 172.21.15.130:0/4040593622 >> 172.21.15.130:0/4040593622 conn(0x7fea580b46b0 msgr2=0x7fea580aabd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-11T17:33:52.868 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.868+0000 7fea6046a640 1 -- 172.21.15.130:0/4040593622 shutdown_connections 2024-06-11T17:33:52.868 INFO:teuthology.orchestra.run.smithi130.stderr:2024-06-11T17:33:52.868+0000 7fea6046a640 1 -- 172.21.15.130:0/4040593622 wait complete. 2024-06-11T17:33:52.885 INFO:teuthology.misc:Shutting down mds daemons... 2024-06-11T17:33:52.885 INFO:teuthology.misc:Shutting down osd daemons... 2024-06-11T17:33:52.886 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-06-11T17:33:52.886 INFO:teuthology.orchestra.run:waiting for 300 2024-06-11T17:33:52.982 INFO:tasks.ceph.osd.0:Stopped 2024-06-11T17:33:52.982 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-06-11T17:33:52.983 INFO:teuthology.orchestra.run:waiting for 300 2024-06-11T17:33:55.581 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-06-11T17:33:59.084 INFO:tasks.ceph.osd.1:Stopped 2024-06-11T17:33:59.085 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-06-11T17:33:59.085 INFO:teuthology.orchestra.run:waiting for 300 2024-06-11T17:33:59.184 INFO:tasks.ceph.osd.2:Stopped 2024-06-11T17:33:59.185 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-06-11T17:33:59.185 INFO:teuthology.orchestra.run:waiting for 300 2024-06-11T17:33:59.284 INFO:tasks.ceph.osd.3:Stopped 2024-06-11T17:33:59.285 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-06-11T17:33:59.285 INFO:teuthology.orchestra.run:waiting for 300 2024-06-11T17:33:59.367 INFO:tasks.ceph.osd.4:Stopped 2024-06-11T17:33:59.367 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-06-11T17:33:59.368 INFO:teuthology.orchestra.run:waiting for 300 2024-06-11T17:33:59.462 INFO:tasks.ceph.osd.5:Stopped 2024-06-11T17:33:59.463 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-06-11T17:33:59.463 INFO:teuthology.orchestra.run:waiting for 300 2024-06-11T17:33:59.550 INFO:tasks.ceph.osd.6:Stopped 2024-06-11T17:33:59.551 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-06-11T17:33:59.551 INFO:teuthology.orchestra.run:waiting for 300 2024-06-11T17:33:59.649 INFO:tasks.ceph.osd.7:Stopped 2024-06-11T17:33:59.650 INFO:teuthology.misc:Shutting down mgr daemons... 2024-06-11T17:33:59.650 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-06-11T17:33:59.650 INFO:teuthology.orchestra.run:waiting for 300 2024-06-11T17:33:59.680 INFO:tasks.ceph.mgr.y:Stopped 2024-06-11T17:33:59.681 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-06-11T17:33:59.681 INFO:teuthology.orchestra.run:waiting for 300 2024-06-11T17:33:59.710 INFO:tasks.ceph.mgr.x:Stopped 2024-06-11T17:33:59.710 INFO:teuthology.misc:Shutting down mon daemons... 2024-06-11T17:33:59.711 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-06-11T17:33:59.711 INFO:teuthology.orchestra.run:waiting for 300 2024-06-11T17:33:59.747 INFO:tasks.ceph.mon.a:Stopped 2024-06-11T17:33:59.747 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-06-11T17:33:59.747 INFO:teuthology.orchestra.run:waiting for 300 2024-06-11T17:33:59.812 INFO:tasks.ceph.mon.c:Stopped 2024-06-11T17:33:59.813 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-06-11T17:33:59.813 INFO:teuthology.orchestra.run:waiting for 300 2024-06-11T17:33:59.845 INFO:tasks.ceph.mon.b:Stopped 2024-06-11T17:33:59.845 INFO:tasks.ceph:Checking cluster log for badness... 2024-06-11T17:33:59.846 DEBUG:teuthology.orchestra.run.smithi130:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(CEPHADM_STRAY_DAEMON\)' | head -n 1 2024-06-11T17:33:59.870 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi130.front.sepia.ceph.com 2024-06-11T17:33:59.870 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-06-11T17:34:00.262 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi130.front.sepia.ceph.com 2024-06-11T17:34:00.263 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-06-11T17:34:00.438 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi130.front.sepia.ceph.com 2024-06-11T17:34:00.438 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-06-11T17:34:00.582 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-06-11T17:34:00.588 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi130.front.sepia.ceph.com 2024-06-11T17:34:00.588 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-06-11T17:34:00.721 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi172.front.sepia.ceph.com 2024-06-11T17:34:00.721 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-06-11T17:34:00.918 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi172.front.sepia.ceph.com 2024-06-11T17:34:00.919 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-06-11T17:34:01.076 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi172.front.sepia.ceph.com 2024-06-11T17:34:01.076 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-06-11T17:34:01.189 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi172.front.sepia.ceph.com 2024-06-11T17:34:01.189 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-06-11T17:34:01.324 INFO:tasks.ceph:Archiving mon data... 2024-06-11T17:34:01.326 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/lflores-2024-06-10_22:21:08-rados-wip-lflores-testing-2-2024-06-10-1925-distro-default-smithi/7749723/data/mon.a.tgz 2024-06-11T17:34:01.326 DEBUG:teuthology.orchestra.run.smithi130:> mktemp 2024-06-11T17:34:01.332 INFO:teuthology.orchestra.run.smithi130.stdout:/tmp/tmp.4BF8Io2GHM 2024-06-11T17:34:01.332 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.4BF8Io2GHM 2024-06-11T17:34:01.515 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0666 /tmp/tmp.4BF8Io2GHM 2024-06-11T17:34:01.583 DEBUG:teuthology.orchestra.remote:smithi130:/tmp/tmp.4BF8Io2GHM is 599KB 2024-06-11T17:34:01.644 DEBUG:teuthology.orchestra.run.smithi130:> rm -fr /tmp/tmp.4BF8Io2GHM 2024-06-11T17:34:01.650 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/lflores-2024-06-10_22:21:08-rados-wip-lflores-testing-2-2024-06-10-1925-distro-default-smithi/7749723/data/mon.c.tgz 2024-06-11T17:34:01.650 DEBUG:teuthology.orchestra.run.smithi130:> mktemp 2024-06-11T17:34:01.699 INFO:teuthology.orchestra.run.smithi130.stdout:/tmp/tmp.gfshtfLd9u 2024-06-11T17:34:01.699 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.gfshtfLd9u 2024-06-11T17:34:01.885 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0666 /tmp/tmp.gfshtfLd9u 2024-06-11T17:34:01.946 DEBUG:teuthology.orchestra.remote:smithi130:/tmp/tmp.gfshtfLd9u is 599KB 2024-06-11T17:34:02.009 DEBUG:teuthology.orchestra.run.smithi130:> rm -fr /tmp/tmp.gfshtfLd9u 2024-06-11T17:34:02.014 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/lflores-2024-06-10_22:21:08-rados-wip-lflores-testing-2-2024-06-10-1925-distro-default-smithi/7749723/data/mon.b.tgz 2024-06-11T17:34:02.014 DEBUG:teuthology.orchestra.run.smithi172:> mktemp 2024-06-11T17:34:02.020 INFO:teuthology.orchestra.run.smithi172.stdout:/tmp/tmp.wGPxHjGi2k 2024-06-11T17:34:02.020 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.wGPxHjGi2k 2024-06-11T17:34:02.203 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0666 /tmp/tmp.wGPxHjGi2k 2024-06-11T17:34:02.267 DEBUG:teuthology.orchestra.remote:smithi172:/tmp/tmp.wGPxHjGi2k is 599KB 2024-06-11T17:34:02.329 DEBUG:teuthology.orchestra.run.smithi172:> rm -fr /tmp/tmp.wGPxHjGi2k 2024-06-11T17:34:02.334 INFO:tasks.ceph:Cleaning ceph cluster... 2024-06-11T17:34:02.334 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-06-11T17:34:02.336 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-06-11T17:34:02.395 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-06-11T17:34:02.435 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-06-11T17:34:02.436 INFO:tasks.ceph:Archiving crash dumps... 2024-06-11T17:34:02.437 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/lib/ceph/crash to /home/teuthworker/archive/lflores-2024-06-10_22:21:08-rados-wip-lflores-testing-2-2024-06-10-1925-distro-default-smithi/7749723/remote/smithi130/crash 2024-06-11T17:34:02.438 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-06-11T17:34:02.452 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/crash to /home/teuthworker/archive/lflores-2024-06-10_22:21:08-rados-wip-lflores-testing-2-2024-06-10-1925-distro-default-smithi/7749723/remote/smithi172/crash 2024-06-11T17:34:02.453 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-06-11T17:34:02.491 INFO:tasks.ceph:Compressing logs... 2024-06-11T17:34:02.491 DEBUG:teuthology.orchestra.run.smithi130:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-11T17:34:02.496 DEBUG:teuthology.orchestra.run.smithi172:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-11T17:34:02.523 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31129.log 2024-06-11T17:34:02.524 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32369.log 2024-06-11T17:34:02.525 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.31129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32120.log 2024-06-11T17:34:02.525 INFO:teuthology.orchestra.run.smithi130.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31129.log.gz 2024-06-11T17:34:02.526 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.32369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30619.log 2024-06-11T17:34:02.526 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-06-11T17:34:02.526 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.32120.log: /var/log/ceph/ceph-client.admin.30619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31150.log 2024-06-11T17:34:02.526 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-mgr.y.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30619.log.gz 2024-06-11T17:34:02.526 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31153.log 2024-06-11T17:34:02.528 INFO:teuthology.orchestra.run.smithi130.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32120.log.gz 2024-06-11T17:34:02.529 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.31150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99557.log 2024-06-11T17:34:02.529 INFO:teuthology.orchestra.run.smithi130.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31150.log.gz 2024-06-11T17:34:02.529 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.31153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31333.log 2024-06-11T17:34:02.529 INFO:teuthology.orchestra.run.smithi130.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31153.log.gz 2024-06-11T17:34:02.529 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.99557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30558.log 2024-06-11T17:34:02.529 INFO:teuthology.orchestra.run.smithi130.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.99557.log.gz 2024-06-11T17:34:02.529 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.31333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31822.log 2024-06-11T17:34:02.529 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.30558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33103.log 2024-06-11T17:34:02.530 INFO:teuthology.orchestra.run.smithi130.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31333.log.gz 2024-06-11T17:34:02.532 INFO:teuthology.orchestra.run.smithi130.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.30558.log.gz 2024-06-11T17:34:02.532 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.31822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99533.log 2024-06-11T17:34:02.532 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30717.log 2024-06-11T17:34:02.532 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.33103.log: /var/log/ceph/ceph-client.admin.99533.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-06-11T17:34:02.532 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.30717.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30730.log 2024-06-11T17:34:02.533 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.99533.log.gz 2024-06-11T17:34:02.533 INFO:teuthology.orchestra.run.smithi130.stderr: 89.2% 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30717.log.gz 2024-06-11T17:34:02.533 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33103.log.gz 2024-06-11T17:34:02.533 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99298.log 2024-06-11T17:34:02.533 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-osd.0.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.31822.log.gz 2024-06-11T17:34:02.533 INFO:teuthology.orchestra.run.smithi130.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.32369.log.gz 2024-06-11T17:34:02.533 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30939.log 2024-06-11T17:34:02.533 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.30730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98986.log 2024-06-11T17:34:02.533 INFO:teuthology.orchestra.run.smithi130.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.30730.log.gz/var/log/ceph/ceph-client.admin.99298.log: 2024-06-11T17:34:02.534 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.30939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32349.log 2024-06-11T17:34:02.537 INFO:teuthology.orchestra.run.smithi130.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.99298.log.gz 2024-06-11T17:34:02.537 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.98986.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.30939.log.gz 2024-06-11T17:34:02.537 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32083.log 2024-06-11T17:34:02.537 INFO:teuthology.orchestra.run.smithi130.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.98986.log.gz 2024-06-11T17:34:02.537 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.32349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32815.log 2024-06-11T17:34:02.538 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.32083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99194.log 2024-06-11T17:34:02.538 INFO:teuthology.orchestra.run.smithi130.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32349.log.gz 2024-06-11T17:34:02.538 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.32815.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.32083.log.gzgzip 2024-06-11T17:34:02.538 INFO:teuthology.orchestra.run.smithi130.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.32137.log 2024-06-11T17:34:02.538 INFO:teuthology.orchestra.run.smithi130.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32815.log.gz 2024-06-11T17:34:02.538 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25721.log 2024-06-11T17:34:02.538 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.99194.log: /var/log/ceph/ceph-client.admin.32137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30930.log 2024-06-11T17:34:02.538 INFO:teuthology.orchestra.run.smithi130.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.99194.log.gz 2024-06-11T17:34:02.539 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.25721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30479.log 2024-06-11T17:34:02.539 INFO:teuthology.orchestra.run.smithi130.stderr: 87.3%/var/log/ceph/ceph-client.admin.30930.log: -- replaced with /var/log/ceph/ceph-client.admin.25721.log.gz 2024-06-11T17:34:02.539 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-06-11T17:34:02.539 INFO:teuthology.orchestra.run.smithi130.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.30930.log.gz 2024-06-11T17:34:02.539 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.30479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31677.log 2024-06-11T17:34:02.539 INFO:teuthology.orchestra.run.smithi130.stderr:gzip 89.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.30479.log.gz --verbose 2024-06-11T17:34:02.539 INFO:teuthology.orchestra.run.smithi130.stderr: -- /var/log/ceph/ceph-client.admin.31359.log 2024-06-11T17:34:02.539 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-osd.2.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.32137.log.gz 2024-06-11T17:34:02.539 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.31677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99454.log 2024-06-11T17:34:02.542 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.31359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30935.log 2024-06-11T17:34:02.542 INFO:teuthology.orchestra.run.smithi130.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31359.log.gz 2024-06-11T17:34:02.542 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32509.log 2024-06-11T17:34:02.542 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.99454.log: /var/log/ceph/ceph-client.admin.30935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30737.log 2024-06-11T17:34:02.542 INFO:teuthology.orchestra.run.smithi130.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.99454.log.gz 2024-06-11T17:34:02.543 INFO:teuthology.orchestra.run.smithi130.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.30935.log.gz 2024-06-11T17:34:02.543 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.32509.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-06-11T17:34:02.543 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.30737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31125.log 2024-06-11T17:34:02.543 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-mon.a.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.30737.log.gz 2024-06-11T17:34:02.543 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31798.log 2024-06-11T17:34:02.543 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99506.log 2024-06-11T17:34:02.543 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.31125.log: 87.5%/var/log/ceph/ceph-client.admin.31798.log: -- replaced with /var/log/ceph/ceph-client.admin.31125.log.gz 2024-06-11T17:34:02.543 INFO:teuthology.orchestra.run.smithi130.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.31798.log.gz 2024-06-11T17:34:02.548 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99480.log 2024-06-11T17:34:02.548 INFO:teuthology.orchestra.run.smithi130.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.32509.log.gz 2024-06-11T17:34:02.548 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.99506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32105.log 2024-06-11T17:34:02.548 INFO:teuthology.orchestra.run.smithi130.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.99506.log.gz 2024-06-11T17:34:02.548 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32119.log 2024-06-11T17:34:02.548 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.99480.log: /var/log/ceph/ceph-client.admin.32105.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.99480.log.gz 2024-06-11T17:34:02.548 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30532.log 2024-06-11T17:34:02.549 INFO:teuthology.orchestra.run.smithi130.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.32105.log.gz 2024-06-11T17:34:02.549 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99090.log 2024-06-11T17:34:02.549 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.32119.log: /var/log/ceph/ceph-client.admin.30532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31385.log 2024-06-11T17:34:02.549 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.99090.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30532.log.gz 2024-06-11T17:34:02.549 INFO:teuthology.orchestra.run.smithi130.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.99090.log.gz 2024-06-11T17:34:02.549 INFO:teuthology.orchestra.run.smithi130.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32119.log.gz 2024-06-11T17:34:02.549 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30941.log 2024-06-11T17:34:02.549 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.31385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99376.log 2024-06-11T17:34:02.549 INFO:teuthology.orchestra.run.smithi130.stderr: 89.2%/var/log/ceph/ceph-client.admin.30941.log: -- replaced with /var/log/ceph/ceph-client.admin.31385.log.gz 2024-06-11T17:34:02.550 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25464.log 2024-06-11T17:34:02.550 INFO:teuthology.orchestra.run.smithi130.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.30941.log.gz 2024-06-11T17:34:02.550 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.99376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31763.log 2024-06-11T17:34:02.551 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32328.log 2024-06-11T17:34:02.551 INFO:teuthology.orchestra.run.smithi130.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99376.log.gz 2024-06-11T17:34:02.551 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.25464.log: /var/log/ceph/ceph-client.admin.31763.log: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.25464.log.gz 2024-06-11T17:34:02.552 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31693.log 2024-06-11T17:34:02.552 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.32328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30933.log 2024-06-11T17:34:02.553 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.31693.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.31763.log.gz 2024-06-11T17:34:02.553 INFO:teuthology.orchestra.run.smithi130.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.31693.log.gz 2024-06-11T17:34:02.554 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31540.log 2024-06-11T17:34:02.555 INFO:teuthology.orchestra.run.smithi130.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.32328.log.gz 2024-06-11T17:34:02.555 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30733.log 2024-06-11T17:34:02.555 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.30933.log: /var/log/ceph/ceph-client.admin.31540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32009.log 2024-06-11T17:34:02.555 INFO:teuthology.orchestra.run.smithi130.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.30933.log.gz 2024-06-11T17:34:02.556 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.30733.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.31540.log.gz 2024-06-11T17:34:02.556 INFO:teuthology.orchestra.run.smithi130.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.30733.log.gz 2024-06-11T17:34:02.556 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31597.log 2024-06-11T17:34:02.557 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.32009.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-06-11T17:34:02.557 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.31597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31865.log 2024-06-11T17:34:02.558 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-osd.3.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.32009.log.gz 2024-06-11T17:34:02.558 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33186.log 2024-06-11T17:34:02.561 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.31865.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.31865.log.gz 2024-06-11T17:34:02.561 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99012.log 2024-06-11T17:34:02.563 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.33186.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.33186.log.gz 2024-06-11T17:34:02.563 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31961.log 2024-06-11T17:34:02.564 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.99012.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.99012.log.gz 2024-06-11T17:34:02.565 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30736.log 2024-06-11T17:34:02.566 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25494.log 2024-06-11T17:34:02.566 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25614.log 2024-06-11T17:34:02.566 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.25494.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-06-11T17:34:02.567 INFO:teuthology.orchestra.run.smithi172.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.25494.log.gz 2024-06-11T17:34:02.567 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.25614.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-06-11T17:34:02.567 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-osd.7.log: gzip 88.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.25614.log.gz 2024-06-11T17:34:02.567 INFO:teuthology.orchestra.run.smithi172.stderr: --verbose -- /var/log/ceph/ceph-client.admin.25662.log 2024-06-11T17:34:02.567 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25542.log 2024-06-11T17:34:02.569 INFO:teuthology.orchestra.run.smithi172.stderr:gzip/var/log/ceph/ceph-client.admin.25662.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.25518.log 2024-06-11T17:34:02.569 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.25542.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.25662.log.gz 2024-06-11T17:34:02.569 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-06-11T17:34:02.569 INFO:teuthology.orchestra.run.smithi172.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.25542.log.gz 2024-06-11T17:34:02.569 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.25518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25566.log 2024-06-11T17:34:02.570 INFO:teuthology.orchestra.run.smithi172.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.25518.log.gz 2024-06-11T17:34:02.570 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-06-11T17:34:02.570 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph-client.admin.25566.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-06-11T17:34:02.570 INFO:teuthology.orchestra.run.smithi172.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.25566.log.gz 2024-06-11T17:34:02.570 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-06-11T17:34:02.571 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.31961.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.31961.log.gz 2024-06-11T17:34:02.572 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-06-11T17:34:02.573 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-06-11T17:34:02.573 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25590.log 2024-06-11T17:34:02.573 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-06-11T17:34:02.573 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.25590.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.25590.log.gz 2024-06-11T17:34:02.573 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25638.log 2024-06-11T17:34:02.574 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.30736.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30736.log.gz 2024-06-11T17:34:02.574 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33187.log 2024-06-11T17:34:02.575 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-osd.4.log: 86.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-06-11T17:34:02.576 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.25638.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.25638.log.gz 2024-06-11T17:34:02.579 INFO:teuthology.orchestra.run.smithi172.stderr: 92.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-06-11T17:34:02.582 INFO:teuthology.orchestra.run.smithi172.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-06-11T17:34:02.582 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32708.log 2024-06-11T17:34:02.584 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.33187.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33187.log.gz 2024-06-11T17:34:02.590 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30735.log 2024-06-11T17:34:02.591 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.32708.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.32708.log.gz 2024-06-11T17:34:02.598 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99428.log 2024-06-11T17:34:02.599 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.30735.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.30735.log.gz 2024-06-11T17:34:02.606 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32520.log 2024-06-11T17:34:02.607 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.99428.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99428.log.gz 2024-06-11T17:34:02.623 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32435.log 2024-06-11T17:34:02.624 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.32520.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32520.log.gz 2024-06-11T17:34:02.638 INFO:teuthology.orchestra.run.smithi130.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.31677.log.gz 2024-06-11T17:34:02.639 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31147.log 2024-06-11T17:34:02.639 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.32435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32814.log 2024-06-11T17:34:02.639 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.31147.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31147.log.gz 2024-06-11T17:34:02.640 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-06-11T17:34:02.641 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.32814.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.32435.log.gz 2024-06-11T17:34:02.641 INFO:teuthology.orchestra.run.smithi130.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32814.log.gz 2024-06-11T17:34:02.642 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31508.log 2024-06-11T17:34:02.649 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph.log: 92.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33104.log 2024-06-11T17:34:02.658 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.31508.log: -- replaced with /var/log/ceph/ceph.log.gz 2024-06-11T17:34:02.659 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99350.log 2024-06-11T17:34:02.662 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.33104.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.33104.log.gz 2024-06-11T17:34:02.663 INFO:teuthology.orchestra.run.smithi130.stderr: 92.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33100.log 2024-06-11T17:34:02.664 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.99350.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99350.log.gz 2024-06-11T17:34:02.664 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31508.log.gz 2024-06-11T17:34:02.665 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32076.log 2024-06-11T17:34:02.666 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.33100.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.33100.log.gz 2024-06-11T17:34:02.666 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99324.log 2024-06-11T17:34:02.667 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.32076.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32076.log.gz 2024-06-11T17:34:02.668 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99272.log 2024-06-11T17:34:02.668 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.99324.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99324.log.gz 2024-06-11T17:34:02.669 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31772.log 2024-06-11T17:34:02.669 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.99272.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99272.log.gz 2024-06-11T17:34:02.670 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32816.log 2024-06-11T17:34:02.671 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.31772.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.31772.log.gz 2024-06-11T17:34:02.672 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99246.log 2024-06-11T17:34:02.673 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.32816.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.32816.log.gz 2024-06-11T17:34:02.673 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32818.log 2024-06-11T17:34:02.674 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.99246.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.99246.log.gz 2024-06-11T17:34:02.674 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-06-11T17:34:02.675 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.32818.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32818.log.gz 2024-06-11T17:34:02.676 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31146.log 2024-06-11T17:34:02.691 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25623.log 2024-06-11T17:34:02.691 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.31146.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31146.log.gz 2024-06-11T17:34:02.692 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31556.log 2024-06-11T17:34:02.692 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.25623.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.25623.log.gz 2024-06-11T17:34:02.707 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30940.log 2024-06-11T17:34:02.708 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.31556.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.31556.log.gz 2024-06-11T17:34:02.731 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31649.log 2024-06-11T17:34:02.731 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.30940.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.30940.log.gz 2024-06-11T17:34:02.739 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31939.log 2024-06-11T17:34:02.746 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.31649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32710.log 2024-06-11T17:34:02.748 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.31939.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.31939.log.gz 2024-06-11T17:34:02.755 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31152.log 2024-06-11T17:34:02.755 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.32710.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.32710.log.gz 2024-06-11T17:34:02.762 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32084.log 2024-06-11T17:34:02.763 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.31152.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31152.log.gz 2024-06-11T17:34:02.771 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-06-11T17:34:02.771 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.32084.log: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.31649.log.gz 2024-06-11T17:34:02.771 INFO:teuthology.orchestra.run.smithi130.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32084.log.gz 2024-06-11T17:34:02.778 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31562.log 2024-06-11T17:34:02.786 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31151.log 2024-06-11T17:34:02.788 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.31562.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.31562.log.gz 2024-06-11T17:34:02.803 INFO:teuthology.orchestra.run.smithi130.stderr: 95.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32760.log 2024-06-11T17:34:02.803 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.31151.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31151.log.gz 2024-06-11T17:34:02.806 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-06-11T17:34:02.814 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31982.log 2024-06-11T17:34:02.815 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.32760.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.32760.log.gz 2024-06-11T17:34:02.830 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99220.log 2024-06-11T17:34:02.833 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.31982.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.31982.log.gz 2024-06-11T17:34:02.846 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32077.log 2024-06-11T17:34:02.847 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.99220.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.99220.log.gz 2024-06-11T17:34:02.862 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99116.log 2024-06-11T17:34:02.866 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.32077.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.32077.log.gz 2024-06-11T17:34:02.882 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32709.log 2024-06-11T17:34:02.883 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.99116.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.99116.log.gz 2024-06-11T17:34:02.892 INFO:teuthology.orchestra.run.smithi130.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-06-11T17:34:02.892 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32759.log 2024-06-11T17:34:02.893 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.32709.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.32709.log.gz 2024-06-11T17:34:02.894 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31531.log 2024-06-11T17:34:02.895 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.32759.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.32759.log.gz 2024-06-11T17:34:02.896 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31524.log 2024-06-11T17:34:02.899 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.31531.log: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.31531.log.gz 2024-06-11T17:34:02.900 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30504.log 2024-06-11T17:34:02.902 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.31524.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.31524.log.gz 2024-06-11T17:34:02.903 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99168.log 2024-06-11T17:34:02.903 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.30504.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.30504.log.gz 2024-06-11T17:34:02.903 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32817.log 2024-06-11T17:34:02.904 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.99168.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99168.log.gz 2024-06-11T17:34:02.904 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31996.log 2024-06-11T17:34:02.905 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.32817.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32817.log.gz 2024-06-11T17:34:02.906 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31724.log 2024-06-11T17:34:02.916 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.31996.log: 92.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31925.log 2024-06-11T17:34:02.919 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.31724.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.31724.log.gz 2024-06-11T17:34:02.919 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31996.log.gz 2024-06-11T17:34:02.920 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30724.log 2024-06-11T17:34:02.922 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.31925.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.31925.log.gz 2024-06-11T17:34:02.923 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33102.log 2024-06-11T17:34:02.924 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.30724.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.30724.log.gz 2024-06-11T17:34:02.924 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32023.log 2024-06-11T17:34:02.925 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.33102.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.33102.log.gz 2024-06-11T17:34:02.926 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99402.log 2024-06-11T17:34:02.927 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.32023.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32023.log.gz 2024-06-11T17:34:02.927 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32383.log 2024-06-11T17:34:02.928 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.99402.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99402.log.gz 2024-06-11T17:34:02.928 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32249.log 2024-06-11T17:34:02.934 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.32383.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.32383.log.gz 2024-06-11T17:34:02.935 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99064.log 2024-06-11T17:34:02.936 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.32249.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.32249.log.gz 2024-06-11T17:34:02.936 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30732.log 2024-06-11T17:34:02.937 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.99064.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99064.log.gz 2024-06-11T17:34:02.937 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32541.log 2024-06-11T17:34:02.938 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.30732.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30732.log.gz 2024-06-11T17:34:02.939 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31516.log 2024-06-11T17:34:02.949 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.32541.log: 92.7%gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20688.log 2024-06-11T17:34:02.955 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.31516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33185.log 2024-06-11T17:34:02.955 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32541.log.gz 2024-06-11T17:34:02.970 INFO:teuthology.orchestra.run.smithi130.stderr: 92.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32394.log 2024-06-11T17:34:02.971 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph.tmp-client.admin.20688.log: /var/log/ceph/ceph-client.admin.33185.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20688.log.gz 2024-06-11T17:34:02.972 INFO:teuthology.orchestra.run.smithi130.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33185.log.gz 2024-06-11T17:34:02.972 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30925.log 2024-06-11T17:34:02.976 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.32394.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.31516.log.gz 2024-06-11T17:34:02.976 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32394.log.gz 2024-06-11T17:34:02.977 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30683.log 2024-06-11T17:34:02.977 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.30925.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.30925.log.gz 2024-06-11T17:34:02.978 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31548.log 2024-06-11T17:34:02.979 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.30683.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.30683.log.gz 2024-06-11T17:34:02.979 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32470.log 2024-06-11T17:34:02.990 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.31548.log: 94.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32761.log 2024-06-11T17:34:02.996 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.32470.log: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.31548.log.gz 2024-06-11T17:34:02.996 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32470.log.gz 2024-06-11T17:34:02.996 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30657.log 2024-06-11T17:34:02.997 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.32761.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32761.log.gz 2024-06-11T17:34:02.998 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33101.log 2024-06-11T17:34:02.999 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.30657.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.30657.log.gz 2024-06-11T17:34:02.999 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30945.log 2024-06-11T17:34:03.000 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.33101.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.33101.log.gz 2024-06-11T17:34:03.001 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99142.log 2024-06-11T17:34:03.003 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.30945.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.30945.log.gz 2024-06-11T17:34:03.003 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99038.log 2024-06-11T17:34:03.004 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.99142.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99142.log.gz 2024-06-11T17:34:03.004 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.99038.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99038.log.gz 2024-06-11T17:34:03.421 INFO:teuthology.orchestra.run.smithi130.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.31597.log.gz 2024-06-11T17:34:03.615 INFO:teuthology.orchestra.run.smithi130.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-06-11T17:34:04.268 INFO:teuthology.orchestra.run.smithi172.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-06-11T17:34:04.784 INFO:teuthology.orchestra.run.smithi130.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-06-11T17:34:07.651 INFO:teuthology.orchestra.run.smithi172.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-06-11T17:34:07.747 INFO:teuthology.orchestra.run.smithi130.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-06-11T17:34:07.887 INFO:teuthology.orchestra.run.smithi172.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-06-11T17:34:08.188 INFO:teuthology.orchestra.run.smithi172.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-06-11T17:34:08.247 INFO:teuthology.orchestra.run.smithi130.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-06-11T17:34:08.448 INFO:teuthology.orchestra.run.smithi130.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-06-11T17:34:08.871 INFO:teuthology.orchestra.run.smithi172.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-06-11T17:34:08.873 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-06-11T17:34:08.873 INFO:teuthology.orchestra.run.smithi172.stderr:real 0m6.329s 2024-06-11T17:34:08.873 INFO:teuthology.orchestra.run.smithi172.stderr:user 0m23.352s 2024-06-11T17:34:08.873 INFO:teuthology.orchestra.run.smithi172.stderr:sys 0m0.738s 2024-06-11T17:34:08.925 INFO:teuthology.orchestra.run.smithi130.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-06-11T17:34:08.926 INFO:teuthology.orchestra.run.smithi130.stderr: 2024-06-11T17:34:08.926 INFO:teuthology.orchestra.run.smithi130.stderr:real 0m6.429s 2024-06-11T17:34:08.927 INFO:teuthology.orchestra.run.smithi130.stderr:user 0m27.000s 2024-06-11T17:34:08.927 INFO:teuthology.orchestra.run.smithi130.stderr:sys 0m0.955s 2024-06-11T17:34:08.928 INFO:tasks.ceph:Archiving logs... 2024-06-11T17:34:08.928 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/log/ceph to /home/teuthworker/archive/lflores-2024-06-10_22:21:08-rados-wip-lflores-testing-2-2024-06-10-1925-distro-default-smithi/7749723/remote/smithi130/log 2024-06-11T17:34:08.929 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-11T17:34:12.321 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/log/ceph to /home/teuthworker/archive/lflores-2024-06-10_22:21:08-rados-wip-lflores-testing-2-2024-06-10-1925-distro-default-smithi/7749723/remote/smithi172/log 2024-06-11T17:34:12.322 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-11T17:34:15.466 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-06-11T17:34:15.475 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-06-11T17:34:15.476 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-11T17:34:15.478 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-11T17:34:15.551 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-06-11T17:34:15.561 INFO:teuthology.task.clock:Checking final clock skew... 2024-06-11T17:34:15.562 DEBUG:teuthology.orchestra.run.smithi130:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-11T17:34:15.564 DEBUG:teuthology.orchestra.run.smithi172:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-11T17:34:15.575 INFO:teuthology.orchestra.run.smithi130.stdout: remote refid st t when poll reach delay offset jitter 2024-06-11T17:34:15.575 INFO:teuthology.orchestra.run.smithi130.stdout:============================================================================== 2024-06-11T17:34:15.575 INFO:teuthology.orchestra.run.smithi130.stdout:+hv01.front.sepi 67.205.162.81 3 u 15 64 377 0.078 -4.537 0.607 2024-06-11T17:34:15.575 INFO:teuthology.orchestra.run.smithi130.stdout:+hv02.front.sepi 155.248.196.28 3 u 15 64 377 0.110 -2.866 0.731 2024-06-11T17:34:15.575 INFO:teuthology.orchestra.run.smithi130.stdout:*hv03.front.sepi 74.6.168.72 3 u 5 64 377 0.087 -3.833 0.451 2024-06-11T17:34:15.575 INFO:teuthology.orchestra.run.smithi130.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2024-06-11T17:34:15.578 INFO:teuthology.orchestra.run.smithi172.stdout: remote refid st t when poll reach delay offset jitter 2024-06-11T17:34:15.578 INFO:teuthology.orchestra.run.smithi172.stdout:============================================================================== 2024-06-11T17:34:15.578 INFO:teuthology.orchestra.run.smithi172.stdout:*hv01.front.sepi 67.205.162.81 3 u 19 64 377 0.094 -7.746 1.999 2024-06-11T17:34:15.578 INFO:teuthology.orchestra.run.smithi172.stdout:+hv02.front.sepi 155.248.196.28 3 u 12 64 377 0.084 -6.686 3.137 2024-06-11T17:34:15.579 INFO:teuthology.orchestra.run.smithi172.stdout:+hv03.front.sepi 74.6.168.72 3 u 14 64 377 0.091 -3.041 3.306 2024-06-11T17:34:15.579 INFO:teuthology.orchestra.run.smithi172.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2024-06-11T17:34:15.580 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-06-11T17:34:15.588 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-06-11T17:34:15.588 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-06-11T17:34:15.597 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-06-11T17:34:15.608 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-06-11T17:34:15.616 INFO:teuthology.task.internal:Duration was 1556.087829 seconds 2024-06-11T17:34:15.617 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-06-11T17:34:15.625 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-06-11T17:34:15.625 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-11T17:34:15.628 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-11T17:34:15.664 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-06-11T17:34:15.664 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi130.front.sepia.ceph.com 2024-06-11T17:34:15.665 DEBUG:teuthology.orchestra.run.smithi130:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-11T17:34:15.712 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi172.front.sepia.ceph.com 2024-06-11T17:34:15.712 DEBUG:teuthology.orchestra.run.smithi172:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-11T17:34:15.723 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-06-11T17:34:15.723 DEBUG:teuthology.orchestra.run.smithi130:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-11T17:34:15.760 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-11T17:34:15.793 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-06-11T17:34:15.793 DEBUG:teuthology.orchestra.run.smithi130:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-11T17:34:15.828 DEBUG:teuthology.orchestra.run.smithi172:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-11T17:34:15.895 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-06-11T17:34:15.910 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-06-11T17:34:15.911 DEBUG:teuthology.orchestra.run.smithi130:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-11T17:34:15.924 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-11T17:34:15.934 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-06-11T17:34:15.965 DEBUG:teuthology.orchestra.run.smithi130:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-11T17:34:15.968 DEBUG:teuthology.orchestra.run.smithi172:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-11T17:34:15.976 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = core 2024-06-11T17:34:15.989 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = core 2024-06-11T17:34:16.081 DEBUG:teuthology.orchestra.run.smithi130:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-11T17:34:16.085 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-11T17:34:16.086 DEBUG:teuthology.orchestra.run.smithi172:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-11T17:34:16.127 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-11T17:34:16.127 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-06-11T17:34:16.136 INFO:teuthology.task.internal:Transferring archived files... 2024-06-11T17:34:16.137 DEBUG:teuthology.misc:Transferring archived files from smithi130:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/lflores-2024-06-10_22:21:08-rados-wip-lflores-testing-2-2024-06-10-1925-distro-default-smithi/7749723/remote/smithi130 2024-06-11T17:34:16.137 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-11T17:34:16.178 DEBUG:teuthology.misc:Transferring archived files from smithi172:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/lflores-2024-06-10_22:21:08-rados-wip-lflores-testing-2-2024-06-10-1925-distro-default-smithi/7749723/remote/smithi172 2024-06-11T17:34:16.178 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-11T17:34:16.198 INFO:teuthology.task.internal:Removing archive directory... 2024-06-11T17:34:16.198 DEBUG:teuthology.orchestra.run.smithi130:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-11T17:34:16.200 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-11T17:34:16.243 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-06-11T17:34:16.255 INFO:teuthology.task.internal:Not uploading archives. 2024-06-11T17:34:16.255 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-06-11T17:34:16.264 INFO:teuthology.task.internal:Tidying up after the test... 2024-06-11T17:34:16.264 DEBUG:teuthology.orchestra.run.smithi130:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-11T17:34:16.266 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-11T17:34:16.270 INFO:teuthology.orchestra.run.smithi130.stdout: 658622 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Jun 11 17:34 /home/ubuntu/cephtest 2024-06-11T17:34:16.270 INFO:teuthology.orchestra.run.smithi130.stdout: 675015 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Jun 11 17:18 /home/ubuntu/cephtest/mnt.0 2024-06-11T17:34:16.271 INFO:teuthology.orchestra.run.smithi130.stdout: 675016 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Jun 11 17:19 /home/ubuntu/cephtest/mnt.0/client.0 2024-06-11T17:34:16.271 INFO:teuthology.orchestra.run.smithi130.stdout: 1052581 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Jun 11 17:19 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-06-11T17:34:16.271 INFO:teuthology.orchestra.run.smithi130.stdout: 1052622 4 -rw-rw-r-- 1 ubuntu ubuntu 975 Jun 11 17:19 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_neorados_write_operations.log 2024-06-11T17:34:16.271 INFO:teuthology.orchestra.run.smithi130.stdout: 1052613 4 -rw-rw-r-- 1 ubuntu ubuntu 1516 Jun 11 17:20 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_neorados_io.log 2024-06-11T17:34:16.271 INFO:teuthology.orchestra.run.smithi130.stdout: 1052596 4 -rw-rw-r-- 1 ubuntu ubuntu 3564 Jun 11 17:20 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_snapshots_pp.log 2024-06-11T17:34:16.271 INFO:teuthology.orchestra.run.smithi130.stdout: 1052597 4 -rw-rw-r-- 1 ubuntu ubuntu 1151 Jun 11 17:19 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_stat.log 2024-06-11T17:34:16.271 INFO:teuthology.orchestra.run.smithi130.stdout: 1052620 4 -rw-rw-r-- 1 ubuntu ubuntu 1690 Jun 11 17:20 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_neorados_snapshots.log 2024-06-11T17:34:16.271 INFO:teuthology.orchestra.run.smithi130.stdout: 1052610 4 -rw-rw-r-- 1 ubuntu ubuntu 706 Jun 11 17:19 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_neorados_cls.log 2024-06-11T17:34:16.271 INFO:teuthology.orchestra.run.smithi130.stdout: 1052586 8 -rw-rw-r-- 1 ubuntu ubuntu 4760 Jun 11 17:19 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_io_pp.log 2024-06-11T17:34:16.272 INFO:teuthology.orchestra.run.smithi130.stdout: 1052592 8 -rw-rw-r-- 1 ubuntu ubuntu 4227 Jun 11 17:20 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_misc_pp.log 2024-06-11T17:34:16.272 INFO:teuthology.orchestra.run.smithi130.stdout: 1052603 4 -rw-rw-r-- 1 ubuntu ubuntu 2136 Jun 11 17:19 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_service.log 2024-06-11T17:34:16.272 INFO:teuthology.orchestra.run.smithi130.stdout: 1052584 8 -rw-rw-r-- 1 ubuntu ubuntu 5849 Jun 11 17:24 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_aio_pp.log 2024-06-11T17:34:16.272 INFO:teuthology.orchestra.run.smithi130.stdout: 1052619 4 -rw-rw-r-- 1 ubuntu ubuntu 1568 Jun 11 17:20 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_neorados_read_operations.log 2024-06-11T17:34:16.272 INFO:teuthology.orchestra.run.smithi130.stdout: 1052605 4 -rw-rw-r-- 1 ubuntu ubuntu 1196 Jun 11 17:19 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_c_write_operations.log 2024-06-11T17:34:16.272 INFO:teuthology.orchestra.run.smithi130.stdout: 1052616 4 -rw-rw-r-- 1 ubuntu ubuntu 640 Jun 11 17:19 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_neorados_ec_list.log 2024-06-11T17:34:16.272 INFO:teuthology.orchestra.run.smithi130.stdout: 1052609 4 -rw-rw-r-- 1 ubuntu ubuntu 1029 Jun 11 17:19 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_open_pools_parallel.log 2024-06-11T17:34:16.272 INFO:teuthology.orchestra.run.smithi130.stdout: 1052595 4 -rw-rw-r-- 1 ubuntu ubuntu 2063 Jun 11 17:20 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_snapshots.log 2024-06-11T17:34:16.272 INFO:teuthology.orchestra.run.smithi130.stdout: 1052587 28 -rw-rw-r-- 1 ubuntu ubuntu 28199 Jun 11 17:19 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_asio.log 2024-06-11T17:34:16.273 INFO:teuthology.orchestra.run.smithi130.stdout: 1052591 4 -rw-rw-r-- 1 ubuntu ubuntu 2119 Jun 11 17:19 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_misc.log 2024-06-11T17:34:16.273 INFO:teuthology.orchestra.run.smithi130.stdout: 1052590 4 -rw-rw-r-- 1 ubuntu ubuntu 1989 Jun 11 17:19 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_lock_pp.log 2024-06-11T17:34:16.273 INFO:teuthology.orchestra.run.smithi130.stdout: 1052585 4 -rw-rw-r-- 1 ubuntu ubuntu 2526 Jun 11 17:19 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_io.log 2024-06-11T17:34:16.273 INFO:teuthology.orchestra.run.smithi130.stdout: 1052606 4 -rw-rw-r-- 1 ubuntu ubuntu 1679 Jun 11 17:19 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_c_read_operations.log 2024-06-11T17:34:16.273 INFO:teuthology.orchestra.run.smithi130.stdout: 1052607 8 -rw-rw-r-- 1 ubuntu ubuntu 5517 Jun 11 17:19 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_list_parallel.log 2024-06-11T17:34:16.273 INFO:teuthology.orchestra.run.smithi130.stdout: 1052615 4 -rw-rw-r-- 1 ubuntu ubuntu 621 Jun 11 17:19 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_neorados_list.log 2024-06-11T17:34:16.273 INFO:teuthology.orchestra.run.smithi130.stdout: 1052614 4 -rw-rw-r-- 1 ubuntu ubuntu 515 Jun 11 17:19 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_neorados_ec_io.log 2024-06-11T17:34:16.273 INFO:teuthology.orchestra.run.smithi130.stdout: 1052589 4 -rw-rw-r-- 1 ubuntu ubuntu 1844 Jun 11 17:19 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_lock.log 2024-06-11T17:34:16.274 INFO:teuthology.orchestra.run.smithi130.stdout: 1052598 4 -rw-rw-r-- 1 ubuntu ubuntu 1255 Jun 11 17:19 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_stat_pp.log 2024-06-11T17:34:16.274 INFO:teuthology.orchestra.run.smithi130.stdout: 1052612 4 -rw-rw-r-- 1 ubuntu ubuntu 478 Jun 11 17:19 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_neorados_handler_error.log 2024-06-11T17:34:16.274 INFO:teuthology.orchestra.run.smithi130.stdout: 1052608 4 -rw-rw-r-- 1 ubuntu ubuntu 1295 Jun 11 17:19 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_delete_pools_parallel.log 2024-06-11T17:34:16.274 INFO:teuthology.orchestra.run.smithi130.stdout: 1052594 4 -rw-rw-r-- 1 ubuntu ubuntu 1241 Jun 11 17:19 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_pool.log 2024-06-11T17:34:16.274 INFO:teuthology.orchestra.run.smithi130.stdout: 1052593 20 -rw-rw-r-- 1 ubuntu ubuntu 19638 Jun 11 17:33 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_tier_pp.log 2024-06-11T17:34:16.274 INFO:teuthology.orchestra.run.smithi130.stdout: 1052617 4 -rw-rw-r-- 1 ubuntu ubuntu 1338 Jun 11 17:19 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_neorados_misc.log 2024-06-11T17:34:16.274 INFO:teuthology.orchestra.run.smithi130.stdout: 1052588 8 -rw-rw-r-- 1 ubuntu ubuntu 6879 Jun 11 17:20 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_list.log 2024-06-11T17:34:16.274 INFO:teuthology.orchestra.run.smithi130.stdout: 1052604 4 -rw-rw-r-- 1 ubuntu ubuntu 2261 Jun 11 17:19 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_service_pp.log 2024-06-11T17:34:16.274 INFO:teuthology.orchestra.run.smithi130.stdout: 1052599 4 -rw-rw-r-- 1 ubuntu ubuntu 2701 Jun 11 17:19 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_watch_notify.log 2024-06-11T17:34:16.275 INFO:teuthology.orchestra.run.smithi130.stdout: 1052601 32 -rw-rw-r-- 1 ubuntu ubuntu 31022 Jun 11 17:19 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_cmd.log 2024-06-11T17:34:16.275 INFO:teuthology.orchestra.run.smithi130.stdout: 1052602 4 -rw-rw-r-- 1 ubuntu ubuntu 587 Jun 11 17:19 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_cmd_pp.log 2024-06-11T17:34:16.275 INFO:teuthology.orchestra.run.smithi130.stdout: 1052583 4 -rw-rw-r-- 1 ubuntu ubuntu 4034 Jun 11 17:22 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_aio.log 2024-06-11T17:34:16.275 INFO:teuthology.orchestra.run.smithi130.stdout: 1052600 8 -rw-rw-r-- 1 ubuntu ubuntu 4187 Jun 11 17:19 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_watch_notify_pp.log 2024-06-11T17:34:16.275 INFO:teuthology.orchestra.run.smithi130.stdout: 1052618 4 -rw-rw-r-- 1 ubuntu ubuntu 931 Jun 11 17:19 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_neorados_pool.log 2024-06-11T17:34:16.275 INFO:teuthology.orchestra.run.smithi130.stdout: 1052621 4 -rw-rw-r-- 1 ubuntu ubuntu 800 Jun 11 17:19 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_neorados_watch_notify.log 2024-06-11T17:34:16.275 INFO:teuthology.orchestra.run.smithi130.stdout: 1052611 4 -rw-rw-r-- 1 ubuntu ubuntu 579 Jun 11 17:19 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_neorados_cmd.log 2024-06-11T17:34:16.276 INFO:teuthology.orchestra.run.smithi130.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-06-11T17:34:16.288 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-11T17:34:16.288 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi130 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-06-11T17:34:16.297 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-06-11T17:34:16.351 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-06-11T17:34:16.361 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi130 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-06-11T17:34:16.365 INFO:teuthology.run:Summary data: description: rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} duration: 1556.087828874588 failure_reason: 'Command failed (workunit test rados/test.sh) on smithi130 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=37bbe1d8d788b7c9a71280e7d510c295a5853f0b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh''' flavor: default owner: scheduled_lflores@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=733199fabb7b419f86434189f0fa3866 status: fail success: false 2024-06-11T17:34:16.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-11T17:34:16.372 INFO:teuthology.orchestra.run.smithi172.stdout: 658741 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 11 17:34 /home/ubuntu/cephtest 2024-06-11T17:34:16.445 INFO:teuthology.run:FAIL